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Preface 


The  Infrared  and  Electro-Optical  Systems  Handbook  is  a  joint  product  of  the 
Infrared  Information  Analysis  Center  (IRIA)  and  the  International  Society  for 
Optical  Engineering  (SPIE).  Sponsored  by  the  Defense  Technical  Information 
Center  (DTIC),  this  work  is  an  outgrowth  of  its  predecessor,  The  Infrared 
Handbook ,  published  in  1978.  The  circulation  of  nearly  20,000  copies  is  adequate 
testimony  to  its  wide  acceptance  in  the  electro-optics  and  infrared  communities. 
The  Infrared  Handbook  was  itself  preceded  by  The  Handbook  of  Military 
Infrared  Technology.  Since  its  original  inception,  new  topics  and  technologies 
have  emerged  for  which  little  or  no  reference  material  exists.  This  work  is 
intended  to  update  and  complement  the  current  Infrared  Handbook  by  revision, 
addition  of  new  materials,  and  reformatting  to  increase  its  utility.  Of  necessity, 
some  material  from  the  current  book  was  reproduced  as  is,  having  been  adjudged 
as  being  current  and  adequate.  The  45  chapters  represent  most  subject  areas  of 
current  activity  in  the  military,  aerospace,  and  civilian  communities  and  contain 
material  that  has  rarely  appeared  so  extensively  in  the  open  literature. 

Because  the  contents  are  in  part  derivatives  of  advanced  military  technology, 
it  seemed  reasonable  to  categorize  those  chapters  dealing  with  systems  in 
analogy  to  the  specialty  groups  comprising  the  annual  Infrared  Information 
Symposia  (IRIS),  a  Department  of  Defense  (DoD)  sponsored  forum  administered 
by  the  Infrared  Information  Analysis  Center  of  the  Environmental  Research 
Institute  of  Michigan  (ERIM);  thus,  the  presence  of  chapters  on  active,  passive, 
and  countermeasure  systems. 

There  appears  to  be  no  general  agreement  on  what  format  constitutes  a 
“handbook.”  The  term  has  been  applied  to  a  number  of  reference  works  with 
markedly  different  presentation  styles  ranging  from  data  compendiums  to 
tutorials.  In  the  process  of  organizing  this  book,  we  were  obliged  to  embrace  a 
style  of  our  choosing  that  best  seemed  to  satisfy  the  objectives  of  the  book:  to 
provide  derivational  material  data,  descriptions,  equations,  procedures,  and 
examples  that  will  enable  an  investigator  with  a  basic  engineering  and  science 
education,  but  not  necessarily  an  extensive  background  in  the  specific  technol¬ 
ogy,  to  solve  the  types  of  problems  he  or  she  will  encounter  in  design  and  analysis 
of  electro-optical  systems.  Usability  was  the  prime  consideration.  In  addition,  we 
wanted  each  chapter  to  be  largely  self-contained  to  avoid  time-consuming  and 
tedious  referrals  to  other  chapters.  Although  best  addressed  by  example,  the 
essence  of  our  handbook  style  embodies  four  essential  ingredients:  a  brief  but 
well-referenced  tutorial,  a  practical  formulary,  pertinent  data,  and,  finally, 
example  problems  illustrating  the  use  of  the  formulary  and  data. 
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The  final  product  represents  varying  degrees  of  success  in  achieving  this 
structure,  with  some  chapters  being  quite  successful  in  meeting  our  objectives 
and  others  following  a  somewhat  different  organization.  Suffice  it  to  say  that  the 
practical  exigencies  of  organizing  and  producing  a  compendium  of  this  magni¬ 
tude  necessitated  some  compromises  and  latitude.  Its  ultimate  success  will  be 
judged  by  the  community  that  it  serves.  Although  largely  oriented  toward 
system  applications,  a  good  measure  of  this  book  concentrates  on  topics  endemic 
and  fundamental  to  systems  performance.  It  is  organized  into  eight  volumes: 

Volume  1,  edited  by  George  Zissis  of  ERIM,  treats  sources  of  radiation, 
including  both  artificial  and  natural  sources,  the  latter  of  which  in  most 
military  applications  is  generally  regarded  as  background  radiation. 

Volume  2,  edited  by  Fred  Smith  of  OptiMetrics,  Inc.,  treats  the  propagation 
of  radiation.  It  features  significant  amounts  of  new  material  and  data  on 
absorption,  scattering,  and  turbulence,  including  nonlinear  propagation 
relevant  to  high-energy  laser  systems  and  propagation  through  aerody- 
namically  induced  flow  relevant  to  systems  mounted  on  high-performance 
aircraft. 

Volume  3,  edited  by  William  Rogatto  of  Santa  Barbara  Research  Center, 
treats  traditional  system  components  and  devices  and  includes  recent 
material  on  focal  plane  array  read-out  electronics. 

Volume  4,  edited  by  Michael  Dudzik  of  ERIM,  treats  system  design, 
analysis,  and  testing,  including  adjunct  technology  and  methods  such  as 
trackers,  mechanical  design  considerations,  and  signature  modeling. 

Volume  5,  edited  by  Stephen  Campana  of  the  Naval  Air  Warfare  Center, 
treats  contemporary  infrared  passive  systems  such  as  FLIRs,  IRSTs,  IR 
line  scanners,  and  staring  array  configurations. 

Volume  6,  edited  by  Clifton  Fox  of  the  Night  Vision  and  Electronic  Sensors 
Directorate,  treats  active  systems  and  includes  mostly  new  material  on 
laser  radar,  laser  rangefinders,  millimeter-wave  systems,  and  fiber  optic 
systems. 

Volume  7,  edited  by  David  Pollock,  consultant,  treats  a  number  of  coun¬ 
termeasure  topics  rarely  appearing  in  the  open  literature. 

Volume  8,  edited  by  Stanley  Robinson  of  ERIM,  treats  emerging  technolo¬ 
gies  such  as  unconventional  imaging,  synthetic  arrays,  sensor  and  data 
fusion,  adaptive  optics,  and  automatic  target  recognition. 
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Introduction 


This  volume  is  devoted  to  the  design,  analysis,  and  testing  methodologies  of 
electro-optical  systems.  Specifically,  the  volume  describes  the  image  chain 
process  used  in  sensor  development.  This  volume  is  intended  for  scientists  and 
engineers  who  desire  a  working  knowledge  of  the  principles,  models,  and 
practice  of  electro-optical  sensor  development.  The  volume  contains  information 
that  is  supplemented  with  relevant  data,  illustrative  examples,  and  supporting 
references. 

Although  the  primary  thrust  of  this  volume  is  devoted  to  imaging  sensors, 
much  of  the  information  is  relevant  to  other  imaging  and  nonimaging  sensor 
systems.  The  growing  use  of  electro-optical  sensors  in  military  and  commercial 
applications  is  being  used  to  address  a  wide  range  of  unique  sensing  problems. 
While  the  sensing  problems  are  various,  the  physical  principles  of  sensor 
development  are  similar.  This  volume  was  prepared  to  address  those  common 
areas  of  sensor  development. 

The  volume  is  made  up  of  six  chapters.  Chapter  1  by  J.  Michael  Lloyd  is  an 
introduction  to  electro-optical  imaging  systems,  with  special  emphasis  on 
thermal  imaging  sensor  systems.  This  includes  a  systems  engineering  approach 
to  understanding  source,  sensor,  and  image  scene  characteristics.  Central  to  this 
chapter  is  the  application  of  optical  transfer  function  theory  to  describe  sensor 
response  to  various  input  functions.  This  chapter  provides  the  tools  to  make  first- 
order  estimates  of  the  theoretical  limits  of  sensor  resolution,  frequency  response 
and  noise-limited  performance  of  imaging  sensors,  SNR  and  resolution  criteria, 
and  scene  clutter  strengths  relative  to  signal  sources. 

Chapter  2  by  James  Howe  is  an  introduction  to  the  fundamentals  of  electro- 
optical  imaging  systems  performance  prediction.  This  chapter  provides  a  de¬ 
tailed  description  of  the  parameters  of  performance  associated  with  detection, 
recognition,  and  identification  for  first-  and  second-generation  imaging  sensors. 
Howe’s  chapter  continues  the  system  engineering  approach  to  sensor  develop¬ 
ment  and  provides  a  detailed  analysis  on  the  information  content  of  the  scene 
image  produced  by  the  sensor  system.  Of  note  is  the  development  of  the 
methodology  to  understand  the  uses  and  limitations  of  first-  and  second- 
generation  thermal  imaging  system  performance  models. 

Chapter  3  by  Daniel  Vukobratovich  provides  theory  and  practical  data  on  the 
application  of  optomechanical  systems  design  to  electro-optical  sensors.  This 
chapter  treats  many  of  the  practical  implementation  problems  associated  with 
the  design  of  electro-optical  windows,  lens  housings,  and  structural  features. 
This  chapter  is  a  natural  progression  of  the  sensor  system  design  process  to 
assist  the  design  staff  in  creating  actual  sensor  designs  to  meet  the  performance 
characteristics  envisioned  by  the  systems  engineer.  Of  concern  to  all  system 
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developers  is  the  mounting  of  optical  elements  to  ensure  optical  performance 
against  thermal  and  pressure  effects. 

Chapter  4  by  Gerald  Holst  is  an  introduction  to  electro-optical  system  testing 
and  performance  evaluation.  This  chapter  provides  the  methodology  and  proce¬ 
dures  for  establishing  many  of  the  sensor  performance  measures  used  in  imaging 
electro-optical  sensors.  In  addition,  Holst  provides  insight  into  the  practical 
problems  associated  with  optical  collimator,  test  equipment,  and  electronic 
measurements.  This  chapter  complements  the  image  chain  analysis  by  allowing 
the  systems  engineer  to  evaluate  the  results  of  actual  hardware  testing  on 
theoretical  design  criteria. 

Chapter  5  by  Robert  Nasburg  provides  discussions  on  the  theory  and  applica¬ 
tion  of  tracking  and  control  systems.  With  the  ever-increasing  demand  for  image 
processing  of  sensor  information,  Nasburg  provides  a  systems  engineering 
approach  to  sensor-derived  information  applications.  This  chapter  allows  the 
systems  designer  to  develop  an  understanding  of  the  information  processing 
requirements  placed  upon  the  sensor  output.  This  is  especially  important  in 
those  electro-optical  sensors  in  which  preprocessing  or  prefiltering  of  scene 
information  occurs  before  being  presented  to  a  human  operator  for  display. 

Chapter  6  by  John  Conant  and  Malcom  LeCompte  is  an  introduction  to 
signature  modeling.  This  chapter  provides  a  practical  methodology  to  develop  a 
first-order  estimate  of  both  emitted  and  reflected  radiation  from  a  complex 
target  shape.  The  technical  approach  allows  the  systems  developer  to  approxi¬ 
mate  the  performance  of  an  electro-optical  sensor  against  a  new  or  different 
target  class  or  in  a  different  application.  The  chapter  further  serves  as  a  practical 
illustration  of  the  physical  phenomena  inherent  to  the  generation  of  electro- 
optical  signatures. 
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1.1  INTRODUCTION 

Electro-optical  (EO)  imaging  systems  convert  electromagnetic  radiation  at 
optical  wavelengths  to  electrical  signals  for  source  detection  and/or  analog 
visual  display.  They  extend  human  vision  in  wavelength,  signal  sensitivity, 
distance,  and  environmental  conditions.  An  image  of  a  scene  in  the  selected 
waveband  is  produced  in  a  focal  plane  containing  a  detection  medium,  which 
performs  the  transduction  of  light  to  video  signals. 

EO  imaging  has  seven  dimensions:  intensity,  time,  wavelength,  polariza¬ 
tion,  and  the  three  spatial  dimensions.  An  EO  imager  maps  the  three  spatial 
dimensions  of  a  scene  in  perspective  onto  the  two-dimensional  surface  of  the 
focal  plane.  The  dimension  of  range  is  obtainable  if  needed  by  calculations 
from  prior  knowledge  (passive  ranging),  by  pulsed  illumination  (range  gating), 
or  by  coherent  illumination  and  detection  (laser  radar). 

The  video  produced  by  an  imager  typically  is  a  sequence  of  electrical  signals 
whose  amplitudes  are  proportional  to  the  intensity  of  the  scene  at  every  sam¬ 
pled  point.  Position  information  is  coded  by  the  location  of  the  signals  in  time 
within  the  sequence.  Temporal  variations  of  intensity  in  the  scene  typically 
are  sampled  at  a  rate  many  orders  of  magnitude  slower  than  the  light  fre¬ 
quency.  Wavelength  information  may  or  may  not  be  preserved,  and  polari¬ 
zation  rarely  is  exploited. 

This  chapter  is  written  from  the  viewpoint  of  military  tactical  thermal 
imaging.  The  theory  presented  here  is  applicable  to  other  forms  of  EO  imaging 
except  where  blackbody  radiation  is  explicitly  used  in  the  equations.  The  cen¬ 
tral  analyses  account  for  the  blurring  of  image  detail  by  limited  optical  and 
electronic  bandwidth,  for  the  effects  of  sampling  at  discrete  lattice  points,  and 
for  the  masking  of  signal  sources  by  noise. 

Those  analyses  are  based  on  the  hypotheses  that  EO  systems  are  amenable 
to  spatial  and  temporal  frequency-domain  analyses,  that  noise  interferes  with 
perception  in  such  a  way  that  the  linear  ratio  of  signal  to  noise  is  pertinent, 
and  that  human  vision  can  be  modeled  sufficiently  accurately  to  make  useful 
performance  predictions.  For  historical  background,  more  sophisticated  anal¬ 
yses,  or  detailed  applications  of  the  topics  introduced  here,  readers  are  referred 
to  Biberman,1  Dereniak  and  Crowe,2  Hudson,3  Karim,4  Lloyd,5  Spiro  and 
Schlessinger,6  Rosell  and  Harvey,7  Seyrafi,8  and  Shumaker,  Wood,  and  Thacker.9 

1.1.1  Definitions 

Figure  1.1  depicts  the  basic  optical  collection  features  and  parameters  of  an 
EO  imaging  system.  Table  1.1  contains  the  symbols,  acronyms,  and  abbrevi¬ 
ations  used  in  this  chapter.  An  EO  imager  has  a  two-dimensional  angular  field 
of  coverage,  called  the  field  of  view  (FOV),  within  which  it  views  the  scene. 
The  FOV  typically  is  rectangular  with  dimensions  of  A  radians  horizontally 
and  B  radians  vertically.  The  FOV  is  distinguished  from  the  field  of  regard 
(FOR),  which  is  the  larger  two-dimensional  angular  coverage  within  which 
the  imager  may  be  directed  by  stepping  or  panning  to  survey  a  scene  larger 
than  the  FOV. 

The  optical  system  that  maps  the  object  space  onto  the  focal  plane  is  char¬ 
acterized  by  the  linear  dimensions  of  the  optical  aperture  area  that  collects 
the  scene-radiated  energy,  and  by  the  largest  angle  relative  to  the  optical  axis 
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Fig.  1.1  Elementary  features  of  an  EO  imaging  system. 


at  which  the  rays  are  focused  onto  the  detecting  surface.  Those  dimensions 
and  that  angle  determine  the  effective  optical  distance  from  the  aperture, 
called  the  effective  focal  length,  at  which  the  energy  comes  to  a  focus. 

The  optical  aperture  area  determines  how  much  of  a  distant  source’s  radiated 
energy  is  collected  at  a  given  range  from  the  source,  ultimately  determining 
scene  signal  sensitivity.  The  effective  focal  length  determines  the  dimensions 
in  the  focal  plane  of  a  particular  scene  source  at  a  given  range.  The  effective 
focal  length,  the  optical  aperture,  and  the  optical  transmission  determine  the 
energy  flux  of  the  collected  radiation  at  the  focal  plane.  The  ratio  of  the  effective 
focal  length  to  the  aperture  diameter  is  called  the  focal  ratio,  or  /7#.  The  total 
extent  of  the  sensing  surface  projected  through  the  optics  determines  the  an¬ 
gular  FOV  of  the  device. 

The  optical  system  is  further  characterized  by  its  transmission  of  light  as 
a  function  of  wavelength.  A  system  is  described  as  operating  in  the  ultraviolet, 
the  visible,  or  the  infrared  (IR).  The  latter  is  divided  into  the  near-IR,  the 
short-wave  IR,  the  medium- wave  IR,  and  the  long-wave  IR.  The  overall  spectral 
response  is  the  relative  efficiency,  as  a  function  of  wavelength,  in  the  conver¬ 
sion  of  scene  photons  to  electrical  signal.  This  includes  the  spectral  transmis- 
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Table  1.1  Symbols,  Nomenclature,  and  Units 


Symbol  or 
Acronym 

Definition 

Units 

a 

detector  dimension  in  the  horizontal  direction 

m 

A 

horizontal  FOV 

rad 

Ad 

detector  area 

m2 

A0 

optical  collecting  area 

m2 

b 

detector  dimension  in  the  vertical  direction 

m 

B 

vertical  FOV 

rad 

B 

as  subscript,  indicates  a  quantity  associated  with  the  background 

— 

c 

speed  of  light  in  vacuum 

m  s_1 

c 

as  subscript,  indicates  cutoff  in  spatial  frequency  due  to 
diffraction  or  to  detector  geometry 

Cl 

first  Planck  radiation  constant 

W  fim4  m-2 

C2 

second  Planck  radiation  constant 

ixm  K 

C3 

third  Planck  radiation  constant 

— 

C 

mean  value  of  a  Poisson  distribution 

— 

D 

detectivity  1 

w-1 

D* 

specific  detectivity 

cm\/Hz/W 

■Dblip 

background-limited  D* 

cmVHz/W 

•k'BLIP 

background-limited  D *  for  a  full  hemispherical  surround 

cmVHz/W 

Do 

optical  aperture  diameter 

m 

e 

as  subscript,  indicates  an  energy  quantity 

— 

E 

irradiance,  either  energy  or  photon,  depending  on  the  appended 
subscript 

_ 

f 

effective  focal  length 

m 

ft 

electrical  (temporal)  frequency 

Hz 

fufy 

spatial  frequency,  in  cycles  per  unit  of  angular  measure,  typically 
cycles/mrad 

cycles/mrad 

fW 

focal  ratio  or  F-number 

— 

fe 

electrical  frequency 

Hz 

F{  } 

forward  Fourier  transform 

— 

F~H  ) 

inverse  Fourier  transform 

— 

FOR 

field  of  regard 

rad 

FOV 

field  of  view 

rad 

h 

Planck’s  constant 

W  s2 

1 

radiant  intensity,  either  energy  or  photon,  depending  on  the 
appended  subscript 

_ 

k 

Boltzmann’s  constant 

— 

L 

radiance,  either  energy  or  photon,  depending  on  the  subscript 

JR'1 

M 

radiant  exitance,  either  energy  or  photon,  depending  on  the 
subscript 

_ 

nB 

number  of  carriers  due  to  background 

— 

ns 

number  of  signal  carriers 

— 

Tit 

total  number  of  carriers 

— 

NEP 

noise  equivalent  power 

W 

(continued) 
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Table  1.1  (continued) 

Symbol  or 
Acronym 

Definition 

Units 

NETD 

noise  equivalent  temperature  difference 

K 

PSD 

power  spectral  density,  in  appropriate  radiation  units  squared  per 
unit  of  appropriate  bandwidth 

— 

PTF 

phase  transfer  function 

rad 

q 

as  subscript,  indicates  a  photon  quantity 

— 

Q 

radiant  energy,  either  energy  or  photon,  depending  on  the 
appended  subscript 

— 

~Qq 

mean  value  of  photon  number 

— 

r 

radial  separation  of  any  two  points  in  an  autocorrelation  function 

— 

R 

slant  range  to  source 

m 

91 

detector  responsivity 

vr1 

So 

shape  factor  in  optics-to-detector  coupling 

— 

t 

as  subscript,  indicates  a  quantity  associated  with  a  target 

— 

T 

absolute  temperature 

K 

Tf 

frame  time 

s 

Vs 

signal  voltage 

V 

vn 

rms  noise  voltage 

V 

Greek: 

a 

horizontal  detector  angular  subtense 

rad 

P 

vertical  detector  angular  subtense 

rad 

AX 

wavelength  band 

m 

AX 

as  subscript,  indicates  a  quantity  integrated  over  a  waveband 

— 

A/* 

noise  equivalent  electrical  frequency  bandwidth 

Hz 

A  ns 

change  in  number  of  signal  carriers 

— 

A  T 

small  change  in  temperature 

K 

* 

indicates  convolution  of  the  quantities  on  either  side  of  the  symbol 

— 

'Hcs 

cold  shielding  efficiency 

— 

quantum  efficiency 

— 

0 

angle 

— 

X 

wavelength  in  micrometers,  or  as  subscript,  indicates  spectral 
density 

— 

A 

coherence  waveband 

— 

Z 

variable  of  integration;  dummy  variable 

— 

a 

the  square  root  of  variance  of  a  random  variable 

— 

Ve 

Stefan-Boltzmann  constant  in  energy  units 

W  m"2  K~4 

<Jg 

Stefan-Boltzmann  constant  in  photon  units 

s"3  m~6  K~9 

Vq 

square  root  of  the  variance  of  the  photons  counted  in  a 
measurement 

— 

T  a 

atmospheric  transmission 

— 

Taa 

apparent  atmospheric  transmission 

— 

T c/- 

cold  filter  transmission 

— 

t; 

integration  period 

s 

To 

optical  transmission 

— 

Toa 

apparent  optical  transmission 

— 
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Table  1.1  (continued) 


Symbol  or 
Acronym 

Definition 

Units 

4> 

flux,  either  energy  or  photon,  depending  on  the  appended  subscript 

— 

X 

interference  length 

— 

(O 

total  detector  angular  subtense 

sr 

a 

solid  angle  or  total  FOV 

sr 

acs 

cold  shield  solid  angle 

sr 

a p 

perfect  cold  shield  solid  angle 

sr 

sion  of  the  optics  and  the  spectral  response  of  the  detector.  The  aperture  di¬ 
mensions  and  the  waveband  combine  through  the  phenomenon  of  optical 
diffraction  to  set  an  upper  limit  on  the  spatial  frequency  that  can  be  resolved 
by  the  system.  This  diffraction  cutoff  frequency  fc  is  the  ratio  of  the  aperture 
diameter  to  the  mean  wavelength. 

The  process  of  conversion  of  the  radiant  energy  into  an  electrical  signal  is 
called  detection.  The  signal  quantity  that  is  actually  measured  may  be  a  voltage 
or  a  current.  This  signal  has  a  maximum  value  called  the  saturated  signal. 
The  detecting  surface  is  characterized  by  the  dimensions  over  which  energy 
is  spatially  averaged  in  the  focal  plane,  called  the  averaging  aperture  or  unit 
cell.  Concurrent  with  detection  is  the  generation  of  noise,  which  obscures  the 
signal. 

The  quality  of  the  detection  process  is  described  by  the  signal-to-noise  ratio 
(SNR),  the  linear  ratio  of  the  signal  amplitude  to  the  square  root  of  the  sta¬ 
tistical  variance  of  the  noise.  Linear  SNR  is  used  because  of  the  well-known 
result  from  communication  theory  that  the  lowest  detection  false  alarm  rate 
results  from  using  a  threshold  measurement  to  determine  the  presence  or 
absence  of  a  signal.  The  probability  of  detection  is  a  function  only  of  the  signal 
threshold  and  the  SNR.  Another  reason  for  using  SNR  with  imaging  systems 
is  that  there  is  ample  evidence  that  the  lower  limit  of  visual  detectability  is 
set  by  a  thresholding  process.  The  value  of  sensor  SNR  when  the  signal  is 
saturated  is  called  the  dynamic  range. 

The  complete  imaging  system  is  characterized  by  the  spatial  fidelity  with 
which  the  scene  image  is  converted  into  video  signals.  This  is  the  subject  of 
quality  measures  loosely  described  as  "resolution  ”  Angular  spatial  resolving 
power  is  ordinarily  dominated  by  the  angular  projection  through  the  optics  of 
the  smallest  independently  responding  (elemental)  area  of  the  detecting  sur¬ 
face.  Often  the  detecting  surface  is  spatially  delineated  in  a  periodic  two- 
dimensional  pattern  to  form  an  array  of  sensing  elements. 

The  linear  dimension  of  such  a  detecting  element  is  projected  by  the  system 
optics  into  a  linear  angle  in  the  scene  space.  That  angle  is  the  ratio  of  the  cell 
dimension  to  the  optics  effective  focal  length.  Since  the  detector  cell  cannot 
determine  where  within  that  angle  a  source  originates,  the  angular  resolution 
of  the  system  is  of  the  order  of  the  size  of  the  cell’s  angular  projection. 

1.1.2  Characteristics 

Figure  1.2  illustrates  the  major  features  of  energy  transfer  from  the  scene  to 
the  imager.  Scene  radiation  along  a  line  of  sight  (LOS)  from  the  source  to  the 
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Fig.  1.2  EO  imaging  characteristics. 


imager  system  arises  from  four  mechanisms:  self-emission,  transmission  of 
emissions  from  objects  behind  the  source,  reflection  of  remote  emissions  from 
objects  in  front  of  the  source,  and  scattering  and/or  diffraction  of  all  of  these 
from  outside  the  LOS  into  the  LOS  by  the  intervening  atmosphere.  For  ex¬ 
ample,  the  LOS  to  a  point  in  a  cloud  may  contain  emitted  radiation  from  the 
cloud’s  internal  energy,  transmitted  energy  from  sources  behind  it  along  the 
LOS,  scattering  from  sources  along  other  lines  of  sight,  and  reflections  from 
sources  external  to  the  cloud. 

All  these  phenomena  are  angularly  dependent,  so  that  the  appearance  of  a 
differential  element  of  a  source’s  surface  may  depend  on  the  viewing  angle 
relative  to  the  surface  normal  and  on  the  angles  of  external  sources  relative 
to  the  surface  normal.  Thus  a  particular  surface  may  take  on  quite  different 
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appearances  depending  on  its  orientation  to  external  sources  and  to  the  viewer. 
In  the  visible,  a  thundercloud  in  sunlight  may  appear  white  toward  the  sun 
and  black  underneath,  and  in  the  infrared  an  aircraft’s  bare  aluminum  skin 
on  a  clear  night  may  appear  warm  on  the  side  and  cold  on  the  top.  The  infrared 
contrast  of  natural  terrain  features  is  strongly  dependent  on  the  strength  of 
insolation,  and  thermal  washouts  may  occur  twice  per  day. 

While  it  is  possible,  given  enough  measurements,  to  describe  the  appearance 
of  any  source  goniometrically,  in  practice  the  description  usually  is  reduced 
to  the  specification  of  a  single  "apparent”  quantity,  which  lumps  the  effects  of 
all  of  the  mediating  factors  together.  For  example,  in  the  visible,  some  measure 
of  the  apparent  contrast  of  a  source  relative  to  its  background  is  usually  spec¬ 
ified.  In  the  infrared,  the  apparent  temperature  difference  of  a  source  relative 
to  the  apparent  temperature  of  its  background  is  often  specified. 

The  radiant  characterization  of  a  source  relative  to  its  background  is  called 
the  source  signature.  Signature  is  composed  of  five  elements:  differences  in 
intensity  between  source  and  background  with  insignificant  spectral  differ¬ 
ences  (contrast),  differences  in  intensity  with  wavelength  (color),  differences 
in  polarization,  differences  in  the  spatial  correlation  length  and  the  intensity 
relative  to  surrounding  scene  sources  (conspicuity),  and  time  variations  (mo¬ 
tion  and  intensity  modulation). 


1.1.3  Impediments  to  Source  Detection 

Even  though  a  source  may  manifest  numerous  differences  from  its  surround, 
these  differences  do  not  necessarily  propagate  to  the  imager.  The  conspicuity 
of  a  source  is  reduced  by  atmospheric  absorption,  scattering,  diffraction,  and 
scintillation.  It  is  also  common,  especially  in  infrared  imaging  and  in  long- 
range  visible  imaging,  for  the  source  signature  to  be  superimposed  on  an 
uninformative  and  contrast-reducing  background  "pedestal.” 

This  is  a  result,  in  the  thermal  case,  of  the  lowest  apparent  temperature  in 
the  scene  and,  in  the  visible  case,  of  atmospheric  scattering.  For  example,  in 
the  8-  to  14-fim  spectral  band,  the  thermal  radiation  from  a  300  K  background 
is  65  times  larger  than  the  radiation  difference  due  to  a  1  K  variation  in  that 
background.  If  a  pedestal  is  not  removed  by  signal  processing,  it  consumes 
dynamic  range,  and  reduces  the  displayed  contrast  and  the  detectability  of  the 
source. 

In  the  absence  of  conspicuous  amplitude  differences,  the  distinctions  be¬ 
tween  source  and  background  may  be  the  sharpness  of  the  transition  between 
them  and  the  degree  to  which  the  dimensions  of  the  target  are  distinguishable 
from  those  of  typical  background  spatial  variations.  The  source  dimensions 
and  edge  sharpness  do  not  necessarily  propagate  to  the  final  displayed  image 
with  full  fidelity. 

Many  phenomena  result  in  blurring  of  details  and  the  softening  of  transi¬ 
tions.  Fundamental  among  these  are  optical  diffraction,  averaging  of  image 
detail  by  a  finite-sized  spatially  integrating  detector,  and  averaging  of  tem¬ 
porally  coded  (scanned  or  sampled)  spatial  variations  due  to  finite  electrical 
signal  processing  bandwidth.  These  phenomena  may  be  described  by  integro- 
differential  equations  in  space  and/or  time,  but  are  more  conveniently  de¬ 
scribed  in  the  complex  frequency  domain. 
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Another  impediment  to  detection  is  the  random  fluctuation  of  noise.  Noise 
is  any  spatial  or  temporal  variation  in  the  image  of  the  scene  that  significantly 
interferes  with  detection  and  estimation  of  the  source.  It  is  often  described  as 
"unwanted  signal”  Noise  arises  from  statistical  variations  in  the  spatial  di¬ 
mensions  of  the  background  features  (clutter),  temporal  variations  of  the  source 
relative  to  the  background  (movement  and  orientation),  atmospheric  effects 
(scintillation,  transmission  variations,  and  self-radiation  variations),  quantum 
statistical  variations  in  the  source  and  background  emissions  (photon  noise), 
spatial  discontinuities  in  signal  detection  (sampled-data  "aliasing”),  electronic 
noise  in  the  detection  and  signal  processing  functions,  and  "optical”  noise 
(glare,  shading,  ghosting). 

Another  limitation  is  that  no  imaging  system  produces  imagery  of  a  point 
in  the  scene  all  of  the  time.  Some  fraction  of  the  time  is  always  devoted  to 
"overhead”  control  and  processing  functions,  to  optically  directing  a  detector 
of  small  angular  extent  to  cover  a  larger  solid  angle  in  space,  or  to  readout 
discharge  of  detective  elements.  Since  scene  signals  are  always  temporally 
integrated  in  some  way  to  improve  the  SNR,  these  overhead  functions  reduce 
the  time  available  for  signal  integration  and  therefore  reduce  signal  sensitivity. 

1.1.4  Fundamental  Limits 

Jamieson10  examined  the  physical  limits  to  passive  spatially  incoherent  in¬ 
frared  sensing  resulting  from  the  quantum  nature  of  light  and  from  the  un¬ 
certainty  principle.  He  determined  the  number  of  independent  measurements 
a  sensor  can  make  in  the  four-dimensional  space  of  time,  wavelength,  and  two 
angles.  He  assumed  perfect  optics,  perfect  detectors,  the  photon  statistics  noise 
limit,  spatial  incoherence,  and  temporal  coherence  at  light  frequencies. 

The  number  of  degrees  of  freedom  is  the  total  number  of  independent  mea¬ 
surements  a  sensor  can  make.  That  is,  it  is  the  number  of  distinguishable  cells 
into  which  the  sensor  may  dissect  the  four-dimensional  signal  by  spatial,  tem¬ 
poral,  or  optical-temporal  coherence  techniques.  The  degrees  of  freedom  N  is 
given  by 


N  = 


2 Aon  2Ax 
A2  A2 


2tfTf  , 


(1.1) 


where 

A0  =  optical  aperture  area 
O  =  total  solid  angular  field  of  view 
A  =  wavelength 

A  =  wavelength  band  used  for  discrimination  by  optical-temporal 
coherence  techniques 

X  =  maximum  interference  length  exploited  by  the  optical-temporal 
coherence  measurement 
A/*  =  temporal  bandwidth  of  the  sensor 
Tf  =  frame  time  required  to  cover  (1  with  the  detectors  used. 

As  an  example,  consider  a  staring  imager  with  a  unit  cell  solid  angular  di¬ 
mension  H/  operating  at  100%  temporal  efficiency.  Such  an  imager  has  a 
bandwidth  tf  of  0/(277 TO/),  so  that  2Ttf  =  ft/Oirfl/).  Let  the  sensor  have  a 
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detector  array  with  640  columns  of  480  elements  each,  consistent  with  a  tele¬ 
vision  format.  Let  the  horizontal  FOV  be  0.04  rad  and  the  vertical  FOV  be 
0.03  rad  so  that  fl  is  approximately  640  x  480  d/.  Let  the  sensor  operate  at 
a  frame  rate  of  30  Hz  and  work  through  a  20-cm-diameter  optical  aperture 
(0.0314-m2  area)  at  a  mean  wavelength  of  9  |xm.  Assuming  that  the  sensor 
does  not  exploit  temporal  coherence,  only  the  first  and  the  third  factors  of  Eq. 
(1.1)  are  used,  and  N  has  the  value 


N  = 


2(0.0314  m2)(0.0012  sr) 
(9  x  10"6  m)2 


-(640  x  480) 

TT 


=  9.1  x  1010  degrees  of  freedom  in  space  and  time  . 


Jamieson  also  indicated  an  approach  to  determining  the  number  of  distin¬ 
guishable  levels  within  the  distinguishable  cells  based  on  the  fundamental 
limit  due  to  statistical  photon  flux  variations. 


1.1.5  Idealized  Modeling 

For  first-order  analyses  such  as  those  presented  in  this  chapter,  simplifying 
assumptions  are  necessary  to  reduce  the  requirements  for  input  data  and  to 
reduce  the  computational  burden.  Light  from  the  scene  is  assumed  to  be  poly¬ 
chromatic  with  sufficient  spectral  width  to  be  spatially  incoherent.  Sources 
and  backgrounds  are  assumed  to  be  graybody  radiators  characterizable  by 
equivalent  blackbody  temperatures.  Color  is  assumed  to  be  uninformative. 

Polarization  is  assumed  to  be  random.  Signal  processing  is  assumed  to  be 
linear  for  the  signal  amplitudes  of  interest.  Noise  is  assumed  to  have  a  Gaus¬ 
sian  amplitude  distribution.  These  assumptions  are  routinely  violated  in  the 
real  world  to  some  degree,  but  usually  not  to  such  an  extent  that  they  seriously 
distort  the  following  models. 


1.2  PHOTON  COLLECTION  AND  SIGNAL-TO-NOISE  RATIO 

Noise  in  imagery  masks  detection  of  changes  in  the  scene  optical  characteristics 
of  interest.  To  characterize  an  imager’s  capability  to  sense  at  a  distance,  it  is 
useful  to  have  a  single  summary  measure  roughly  indicative  of  its  ability  to 
detect  signal  variations.  The  simplest  measure  of  noisiness  is  the  value  of  the 
signal  change,  which  equals  the  root  mean  square  (rms)  value  of  the  broadband 
noise  at  the  point  of  detection.  Such  a  measure  is  referred  to  as  a  sensitivity, 
analogous  to  similar  measures  in  communication  and  radar. 

For  example,  noise  equivalent  power  (NEP)  is  the  incident  power  at  a  de¬ 
tector’s  surface  that  produces  a  unity  ratio  of  rms  signal  to  rms  noise  in  the 
detector  output.  Noise  equivalent  irradiance  (NEI)  is  the  peak-to-peak  irra- 
diance  differential  at  the  optical  entrance  aperture  of  a  system,  which  produces 
unity  SNR  at  the  output  of  a  specified  stage  of  the  signal  processing.  NEI  is 
useful  for  describing  the  capability  of  point  source  detection  systems.  The  noise 
equivalent  temperature  difference  (NETD)  is  the  target  temperature  differ¬ 
ence,  which  for  a  broad  target  produces  a  unity  ratio  of  peak-to-peak  signal 
to  rms  noise  at  a  specified  signal  processing  output. 
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The  purpose  of  such  measures  is  twofold.  First,  they  communicate  in  an 
approximate  way  how  noisy  the  instrument  is  relative  to  the  signal  amplitudes 
to  be  detected.  Second,  they  appear  in  more  sophisticated  measures  of  device 
performance,  such  as  false  alarm  rate  or  probability  of  recognition,  which  take 
into  account  the  effects  of  subsequent  signal  processing. 


1.2.1  Noise  Characterization 

Noise  is  characterized  by  the  probability  distribution  of  its  amplitude  and  by 
its  correlation  lengths  in  space  and  in  time,  or  by  the  equivalent  temporal  and 
spatial  power  spectral  densities  in  the  frequency  domain.  The  theoretical  limit 
to  noise  in  imaging  systems  is  the  random  absorption  rate  of  photons  by  the 
detector.  This  is  called  generation  noise  because  it  is  manifested  as  a  random 
rate  of  signal  carrier  generation  due  to  the  random  arrival  rate  of  photons  at 
the  detector.  The  statistics  of  generation  noise  are  assumed  to  follow  those  of 
photon  noise. 

For  sufficiently  high  photon  fluxes  of  monochromatic  light  temporally  un¬ 
correlated  at  light  frequencies,  the  discrete  photon  amplitude  statistics  are 
assumed  to  be  Poisson  distributed.  The  variance  is  given  by 

<Jq  =  Qq  ,  0-2) 

where  Q q  is  the  average  value  of  Qq,  the  random  variable  giving  the  number 
of  photons  absorbed  by  a  detector  within  the  smallest  independent  (correlated) 
time  period  of  detection.  This  collection  time  is  determined  by  a  specific  in¬ 
tegration  time  or  by  time  constants  inherent  in  the  detection  process. 

The  discrete  Poisson  distribution  is  assumed  for  high  fluxes  to  tend  toward 
a  continuous  Gaussian  distribution.  For  Gaussian  statistics  the  probability 
that  the  random  variable  Qq  takes  the  value  £  is 


P(Q  = 


exp  -  (£  -  Qq)2/2(Tq  . 


(1.3) 


For  the  case  of  blackbody  radiation  (neither  monochromatic  nor  temporally 
uncorrelated),  the  variance  is  not  given  by  Eq.  (1.2),  but  by  the  Bose-Einstein 
equation: 


a 


2 

Q 


=  Qq 


exp(hclkkT) 
exp(hclXkT)  -  1 


(1.4) 


The  term  in  brackets  is  ordinarily  close  to  unity.  The  SNR  is  defined  as  the 
ratio  of  the  mean  number  of  photons  counted  to  the  square  root  of  the  variance 
of  the  count.  Then  the  central  result  of  photon  detection  theory  is  that  the 
SNR  in  most  cases  is  given  by 
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With  all  noise,  care  must  be  taken  in  calculating  statistics  from  ensembles 
and  applying  them  to  a  single  member  of  the  population,  or  vice  versa.  If  the 
ergodic  hypothesis  does  not  hold,  the  expected  value  for  one  member  may  not 
equal  the  average  value  for  the  full  ensemble.  This  is  usually  the  case  when 
describing  systems  with  many  detectors.  Remember  that  a  statistical  descrip¬ 
tion  of  one  detector’s  behavior  does  not  necessarily  apply  to  the  entire  array. 

The  power  spectral  density  (PSD)  in  the  temporal  frequency  domain  is  de¬ 
fined  as  the  Fourier  transform  of  the  autocorrelation  function  of  the  noise,  as 
discussed  in  Chapter  2  of  Dereniak  and  Crowe.2  Equivalently,  it  can  be  cal¬ 
culated  from  the  square  of  the  modulus  of  the  Fourier  transform  of  a  sufficiently 
long  time  sequence  of  adequately  sampled  noise.  The  temporal  PSD  of  photon 
noise  is  flat  ("white”)  except  as  modified  by  time  constants  in  the  detection 
mechanism.  The  power  spectrum  in  the  spatial  frequency  domain  of  a  noise 
process  that  has  a  spatial  variation  is  the  multidimensional  Fourier  transform 
of  the  autocorrelation  function  of  the  noise. 

The  types  of  random  noise  encountered  in  EO  imaging  are  the  aforemen¬ 
tioned  generation  noise,  followed  in  relative  importance  by  noises  referred  to 
as  generation-recombination,  excess  ("1//*”  or  "flicker”),  Johnson,  tunneling, 
thermal,  and  pickup.  The  reader  is  referred  to  Dereniak  and  Crowe2  or  Karim4 
for  detailed  treatments  of  detection  noise. 

Generation  noise  is  present  in  all  detectors,  but  in  some  device  structures 
there  are  also  statistical  fluctuations  in  the  rate  at  which  signal  carriers  re¬ 
combine.  This  recombination  noise  usually  has  the  same  power  spectrum  as 
generation  noise,  and  the  two  combine  as  the  root-sum-square.  The  result  is 
called  generation-recombination  noise,  and  its  power  spectrum  is  usually  a 
factor  of  V2  higher  than  generation  noise  alone.  The  existence  of  recombi¬ 
nation  noise  depends  on  whether  recombination  takes  place  before  or  after 
detection.  In  a  photodiode  device,  only  generation  noise  is  present.  In  a  photo- 
conductive  device,  both  generation  and  recombination  are  present. 

Excess  or  l//noise  is  due  largely  to  variations  in  contact  resistances,  believed 
to  be  caused  by  chaotic  variations  in  surface  state  potentials.  Its  power  spec¬ 
trum  typically  is  proportional  to  the  inverse  of  the  electrical  frequency  ft  raised 
to  a  power  of  approximately  1.  Thermal  noise,  also  called  Johnson  noise,  comes 
from  random  variation  in  the  current  in  a  resistive  element  due  to  interactions 
between  carriers  and  phonons.  Tunneling  is  a  quantum  effect  that  occurs  in 
reverse-biased  junctions.  "Temperature”  (as  distinct  from  thermal)  noise  in 
photon  detectors  is  due  to  gain  and  offset  variations  in  detectors  that  are 
extremely  sensitive  to  small  variations  in  cryocooler  coldtip  temperature,  such 
as  extrinsic  silicon  devices. 

Pickup  noises  are  deterministic  and  are  due  to  microphonics,  electrical  ground 
voltage  variations,  and  electromagnetic  interference.  They  tend  to  be  spectral 
rather  than  white,  and  generally  are  not  easily  characterized  because  they 
depend  on  the  spectral  content  of  the  external  forcing  function.  For  example, 
microphonic  noise  may  appear  in  a  cryostatically  cooled  detector  due  to  the 
pulsating  impact  of  the  cooling  liquid  on  the  inner  wall  of  the  dewar.  A  similar 
effect  may  occur  in  a  mechanically  refrigerated  device  due  to  piston  motion 
or  gas  pressure  variations. 

In  addition  to  the  above-mentioned  noises,  there  are  fixed  pattern  noises  in 
arrays  of  detectors  that  cause  the  ergodic  hypothesis  to  be  violated.  These  are 
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"fixed”  in  the  sense  that  their  characteristics  vary  slowly  with  time,  but  they 
are  distributed,  not  necessarily  randomly,  in  space.  Fixed  pattern  noises  may 
be  either  signal  independent  or  signal  dependent.  Examples  of  signal-independent 
noise  are  gain  and  offset  variations  from  detector  to  detector  in  an  array  when 
the  irradiance  has  small  variations.  The  same  array  might  exhibit  signal- 
dependent  noise  due  to  nonlinearity  when  irradiated  with  large  signal  differences. 

1.2.2  Radiant  Energy  Transfer 

Radiometric  units  are  discussed  in  detail  in  Dereniak  and  Crowe,2  by  Meyer- 
Arendt,11  and  by  Zissis.12  Table  1.2  defines  the  radiometric  quantities  used 
herein  in  their  alternative  energy  and  photon  forms.  A  subscript  is  used  to 
distinguish  between  the  two,  e  for  energy  and  q  for  quanta.  The  dominant  type 
of  detector  in  use  now  is  the  quantum  detector,  whose  signal  is  proportional 
to  the  incident  photon  flux  integrated  over  a  fixed  time  interval.  This  makes 
it  desirable  to  use  the  photon  forms.  However,  the  historical  detector  perfor¬ 
mance  measures  are  in  the  energy  forms,  and  detector  performance  measure¬ 
ments  are  usually  still  reported  that  way.  Therefore,  it  is  necessary  to  be  adept 
at  using  both  approaches. 

The  quantities  being  transported  radiatively  are  the  radiant  energy  Qe  in 
joules  and  the  number  of  photons  Qg.  These  are  functions  of  wavelength,  time, 
and  the  radiation  geometry,  including  surface  area  and  solid  angle.  Conse¬ 
quently,  either  type  of  Q  results  from  integration  of  a  spectral  density  or  its 
partial  derivative  over  some  specified  radiation  geometry,  spectral  bandpass, 
and  time  period.  At  a  specific  wavelength  the  two  Q’s  are  related  by  the  photon 
energy  hc/\.  The  energy  transfer  can  be  a  combination  of  emitted,  reflected, 
or  transmitted  energies.  The  following  paragraphs  first  summarize  radiometric 
quantities  for  extended  surfaces,  then  treat  point  sources. 

The  partial  derivatives  with  respect  to  time  of  radiant  energy  and  of  photon 
number  are,  respectively,  the  radiant  flux  in  watts  and  the  photon  flux 
in  photons  per  second.  These  fluxes  are  the  time  rate  of  transport  of  energy  or 
of  photons  integrated  over  a  specified  radiation  transfer  geometry  in  a  specified 
spectral  bandpass.  Fluxes  are  functions  of  the  angles  relative  to  the  normals 
to  the  differential  emitting  and  receiving  surface  areas  being  described. 

For  an  emitting  surface,  the  partial  derivatives  of  emitted  flux  with  respect 
to  surface  area  are  the  radiant  exitance  Me  in  watts  per  square  meter  and  the 
photon  exitance  Mq  in  photons  per  second  per  square  meter.  For  an  absorbing 
surface,  the  partial  derivatives  of  incident  flux  with  respect  to  surface  area 


Table  1.2  Definition  of  Radiometric  Quantities 


Quantity 

Defintion 

Energy  Symbol 

Photon  Symbol 

Radiant  energy  Q 

Total  radiated  energy 

Qe  (J) 

Qq  (photons) 

Radiant  flux  4> 

dQldt 

<t>e  (W) 

(photons  s-1) 

Radiant  exitance  M 

d$/dA 

Me  (W  m"2) 

Mq  (photons  s'1  m-2) 

Irradiance  E 

Ee  (W  m"2) 

Eg  (photons  s"1  m~2) 

Radiance  L 

d2<l> 

(aA  cose)an 

he  (W  m~2sr-1) 

Lq  (photons  s-1  m~2 
sr-1) 

Radiant  intensity  I 

a<i>/an 

Ie  (W  sr'1) 

Iq  (photons  s"1  sr-1) 
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are  the  energy  irradiance  Ee  and  the  photon  irradiance  Eq  in  the  same  units 
as  the  corresponding  exitances. 

The  partial  derivatives  of  the  exitance  with  respect  to  the  solid  angle  through 
which  the  source  radiates,  at  a  specified  angle  0  to  the  surface  normal,  are  the 
energy  radiance  Le  in  watts  per  square  meter  per  steradian  and  the  photon 
radiance  Lq  in  photons  per  second  per  square  meter  per  steradian. 

Radiation  from  a  point  source  is  described  by  the  partial  derivative  of  the 
fluxes  with  respect  to  the  solid  angle  through  which  the  fluxes  are  radiated. 
These  quantities  are  the  energy  radiant  intensity  Ie  in  watts  per  steradian 
and  the  photon  radiant  intensity  Iq  in  photons  per  second  per  steradian.  A 
point  source  is  not  necessarily  a  mathematical  point.  It  could  also  be  an  object, 
which  from  the  perspective  of  the  viewing  device  has  an  angular  subtense 
much  smaller  than  the  spatial  resolution  of  the  device. 

Each  of  the  above  quantities  is  derived  by  integration  over  a  specified  wave¬ 
length  band  of  the  associated  spectral  concentration,  or  wavelength  density, 
of  the  quantity.  Spectral  concentration  is  denoted  by  an  additional  subscript 
X,  for  example,  as  in  Mq\,  which  is  called  the  spectral  photon  exitance  and  has 
units  of  photons  per  square  meter  per  second  per  micrometer. 

For  first-order  analyses,  we  usually  assume  that  Lambert’s  cosine  law  holds, 
meaning  that  extended  sources  are  diffuse  radiators  with  their  radiance  being 
proportional  to  the  cosine  of  the  angle  at  which  they  are  viewed,  so  that 
integration  of  L  over  a  hemisphere  yields 

L  =  Mlit  .  (1.6) 

For  blackbody  radiation,  the  fundamental  radiometric  quantities  from  which 
all  others  are  derived  are  the  spectral  radiant  exitances 


Mp\  = 


X5[exp (hc/kkT)  -  1]  \5[exp(c2/XT)  -  1] 


=  t~Mp\  = 


X4[exp (hc/XkD  ~  1]  X4[exp(c2/XT)  -  1] 


where  the  blackbody  radiation  constants  are  as  given  in  Table  1.3. 

Integration  of  the  spectral  radiant  exitances  over  all  wavelengths  gives  the 
Stefan-Boltzmann  law  for  the  total  radiant  exitances  into  a  hemisphere: 


_5  1.4  rp  4 

-\/r  It  K  1  ,_4 

iWe  —  9  q  —  (Tgi 

45  c2h3 


2  vk3r 
Mq  ~  c2h3 


(1.10) 


with  the  constants  as  given  in  Table  1.3. 
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Table  1.3  Blackbody  Radiation  Constants 

h  =  Planck’s  constant  =  6.626176  x  10“ 34  (W  s2) 
c  =  vacuum  speed  of  light  =  2.997925  x  108  (ms-1) 
k  =  Boltzmann’s  constant  =  1.380662  x  10“ 23  (J  K-1) 
ci  =  first  radiation  constant  =  3.741832  x  108  (W  |xm4  m-2) 

C2  =  second  radiation  constant  =  1.438786  x  104  (fim  K) 

C3  =  third  radiation  constant  =  1.883652  x  1027  (fjun3  s-1  m-2) 
c Te  =  energy  Stefan-Boltzmann  constant  -  5.6703  x  10“ 8  (W  m-2  K-4) 
uq  =  photon  Stefan-Boltzmann  constant  =  5.5204  x  1023  (s-3m-6K-9) 


1.2.3  Extended  Source  Focal  Plane  Flux  Equation 

Figure  1.3  depicts  the  geometry  assumed  for  the  calculation  of  irradiance  on 
the  image  plane  from  a  remote  extended  resolved  source.  The  extended  surface 
is  assumed  to  be  planar,  to  be  normal  to  the  optical  axis,  and  to  follow  Lambert’s 
law.  The  radiating  surface,  the  receiving  aperture,  and  the  receiving  detector 
are  assumed  to  lie  in  parallel  planes.  Appropriate  cosine  factors  may  be  applied 
if  this  is  not  the  case  due  to  target  orientation,  sensor  panning,  sensor  scanning, 
or  off-axis  detector  location.  In  the  worst  case  this  results  in  an  irradiance 
dependence  on  the  cosine  to  the  fourth  power,  as  described  by  Dereniak  and 
Crowe2  and  Karim.4 

In  all  of  the  following  equations,  use  of  consistent  units  has  been  assumed. 
Bear  in  mind  that  the  use  of  convenient  units  will  require  the  addition  to  these 
equations  of  appropriate  unit  conversion  constants.  The  receiving  aperture  has 
an  area  A0,  is  at  a  range  R  from  the  source,  and  forms  an  image  at  an  effective 
distance  f  behind  it.  For  sufficiently  large  R ,  small-angle  approximations  may 
be  made  and  the  aperture  receives  source  radiation  within  a  solid  angle  in 
steradians  of  A0/R2  relative  to  the  source. 

The  source  signature  is  described  by  its  radiant  exitance  M,  in  either  the 
energy  or  the  photon  form.  Lambert’s  law  is  assumed  to  hold  so  that  the  source 
radiance  L\  equals  MJtt.  Unless  explicitly  indicated  otherwise,  the  source 
dimensions  are  assumed  to  be  much  larger  than  the  dimensions  subtended  by 
the  projected  detector  angular  subtense.  Then  the  irradiance  on  the  detector 
is  not  influenced  by  optical  blurring  or  detector  location  in  the  focal  plane 
relative  to  the  source  image. 

The  detector  is  assumed  to  be  rectangular  with  linear  dimensions  a  and  b 
in  the  focal  plane.  These  project  through  the  optics  of  focal  length  /with  angular 
dimensions  a  and  (3  in  radians,  given  respectively  by  aff  and  b/f.  The  projected 
detector  solid  angle  in  radians  is  a>,  which  equals  the  product  ap.  The  detector 
collects  radiance  from  a  source  area  of  a$R2  corresponding  to  the  area  projec¬ 
tion  of  the  detector  solid  angular  subtense  at  the  range  R. 

The  intervening  atmosphere  transmits  the  source  radiance  by  the  factor 
Ta(X)  and  is  assumed  to  have  an  insignificant  signature  itself.  If  this  assumption 
is  untenable,  the  more  general  approach  of  Findlay  and  Cutten13  must  be  used. 
In  most  of  the  subsequent  radiation  equations,  the  symbols  are  given  from  left 
to  right  in  the  order  in  which  they  appear  in  the  imaging  process  to  aid  in 
comprehension. 
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Fig.  1.3  Optical  energy  collection. 


The  spectral  flux  <t>\0  on  the  optical  collecting  aperture  in  either  energy  or 
photon  units  is  then 


^4 

<5x0  =  a(3i?2LxT0(X)— \  =  a$LKTa(k)A0  .  (1.11) 

H 

Using  the  small-angle  approximation  and  allowing  for  the  transmission  t0(\) 
of  the  optics,  the  spectral  flux  of  the  radiation  reaching  the  detector  element 
in  either  photon  or  energy  units  is 


=  apL\To(X)A0To(\)  .  (1.12) 

The  small-angle  approximation  is  made  to  simplify  the  sensitivity  equations 
for  the  fundamental  photon  noise  limit,  and  is  sufficiently  accurate  for  most 
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purposes  for  /7#’s  greater  than  1.5.  See  Chapter  2  of  Karim4  for  the  exact 
expression. 

If  the  flux  is  desired  in  watts,  Le\  will  be  used.  If  the  flux  is  desired  in 
photons  per  second,  Lq\  will  be  used.  If  the  irradiance  on  the  detector  focal 
plane  is  desired,  the  above  expression  may  be  divided  by  the  detector  area. 
For  a  circular  optical  aperture  you  will  often  see  the  alternative  form 


ol$A0 


2 

ab^Dp  _  vAd 

~  4(/y#)2  ’ 


(1.13) 


resulting  in  this  expression  for  the  spectral  flux  on  the  detector: 


ToQO  .  (1.14) 

The  exact  expression  avoiding  the  approximation  made  in  Eq.  (1.12)  has  the 
factor  [1  +  4(/*/#)2]  in  place  of  the  factor  [4 ( /7#)2].  Note  that  the  only  depen¬ 
dence  on  range  here  is  implicit  in  to00.  Up  to  this  point  there  is  no  difference 
between  the  power  and  the  photon  formulations  for  an  extended  source.  They 
diverge  in  the  derivation  of  the  detector  output  SNR  in  Sec.  1.2.5. 1. 


1.2.4  Point  Source  Irradiance  Equations 

Referring  to  Fig.  1.3,  the  point  source  is  assumed  to  be  radiating  uniformly  in 
all  directions.  Then  regardless  of  its  orientation  to  the  LOS,  it  may  be  char¬ 
acterized  relative  to  its  background  by  a  constant  difference  in  spectral  radiant 
intensity  A/\  in  watts  per  steradian  per  micrometer,  or  in  photons  per  second 
per  steradian  per  micrometer. 

The  change  in  spectral  flux  received  by  the  optical  aperture  relative  to  the 
background  flux  is 


A <Dxo  =  A/xt«(X)^|  .  (1-15) 

ti 

Making  the  small-angle  approximation  as  before,  the  change  in  spectral  flux 
on  the  detector  is 


A  =  A/xTa(\)— |toQ0So(\)  (1.16) 

H 

where  the  optical  "shape”  factor  S0(\)  has  a  value  between  zero  and  one.  The 
shape  factor  accounts  for  two  effects.  First,  the  optics  blur  causes  some  of  the 
point  source  flux  to  fall  off  the  detector.  Second,  the  center  of  the  point  source 
image  may  not  fall  on  the  center  of  the  detector  due  to  the  registration  of  the 
array  structure. 

The  dependence  of  S0  on  wavelength  allows  for  optical  chromatic  aberra¬ 
tions.  See  Barhydt14  for  a  more  detailed  discussion  of  the  components  of  the 
shape  factor,  referred  to  by  him  as  "efficiencies.”  The  need  for  a  shape  factor 
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opens  the  detector  flux  description  up  to  a  statistical  treatment  with  a  mini¬ 
mum  value,  a  mean  value,  a  variance,  and  a  maximum  value.  These  may  be 
derived  by  considering  the  possible  range  of  misalignments  of  the  detector 
relative  to  the  source  image. 

1.2.5  Detector  Output  Signal-to-Noise  Ratio 

The  equation  for  the  SNR  of  the  detector  output  depends  on  whether  the  source 
is  unresolved  or  extended,  and  on  whether  an  energy  form  or  a  photon  form 
is  desired.  The  energy  derivation  proceeds  assuming  that  the  detector  is  a 
power-to-voltage  transducer.  The  detector  could  as  easily  be  assumed  to  be  a 
power-to-current  transducer,  in  which  case  references  to  voltages  would  be 
replaced  with  currents.  The  photon  derivation  proceeds  assuming  that  the 
detector  is  an  integrating  photon  counter. 

1.2.5. 1  Extended  Source  SNR.  Using  Eq.  (1.12)  for  the  spectral  flux  on  a 
detector  from  an  extended  source,  the  spectral  fluxes  from  a  target  and  its 
background  are  approximately 

=  apLxrTaU)A0T0(\)  (1.17) 

and 

Owb  =  apLx£Ta(X)A0T0(X)  ,  (1.18) 

where  the  subscripts  T  and  B  refer  to  target  and  background,  respectively. 
The  derivations  of  the  energy  and  photon  extended  source  SNR  equations 
diverge  at  this  point  as  follows. 

Energy  Form .  In  the  energy  formulation,  the  detector  converts  power  to  volt¬ 
age  with  a  spectral  transduction  factor  called  the  spectral  responsivity  $l(X) 
defined  by 


m\)  =  [v/w]  ,  d.i9) 

where  E\d  is  the  rms  value  of  the  fundamental  temporal  frequency  of  the 
radiant  test  input,  and  Vs(\)  is  the  rms  value  of  the  fundamental  temporal 
frequency  of  the  resulting  detector  output  signal.  The  specific  temporal  fre¬ 
quency  of  the  measurement  and  the  temperature  of  the  source  often  are  made 
explicit  inside  the  parentheses  of  Sft(\).  Introducing  the  subscript  e  on  the 
radiance,  for  either  target  or  background  the  spectral  signal  voltage  is 

V(\)  =  a^LeK7a(X)AoTo(X)mx)  .  (1.20) 

Then  the  signal  voltage  difference  in  the  transition  from  background  to  tar¬ 
get  is 


AVQO  =  a p(Le\T  ~  LexB)Ta(X)A0T0(X)9U\)  . 


(1.21) 
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It  is  assumed  that  the  noise  voltage  is  sufficiently  independent  of  the  difference 
between  target  and  background  that  we  may  write  the  spectral  signal-to-noise 
ratio  as 

snroo  =  =  ^r(W  -  i*AB)T„<x)T„(x)a(x)  .  (1.22) 

When  the  target-to-background  difference  is  small,  Eq.  (1.22)  is  valid.  Other¬ 
wise  an  expression  for  Vn  incorporating  Le\r  must  be  used. 

The  SNR  is  obtained  by  spectral  integration: 

aBA  f00 

SNR  =  Jo  (W  -  LeXBha(kh0(mM  d\  .  (1.23) 

The  ratio  is  defined  as  the  spectral  noise  equivalent  power,  NEP(X). 

This  quantity  is  the  change  in  energy  flux  at  a  specified  wavelength  incident 
on  the  detector,  which  produces  a  unity  SNR  in  the  detector  output.  Equation 
(1.23)  can  be  rewritten  using  NEP(X)  as 

SNR  =  apA0 Jo  (W  -  dX  ■  (L24) 

NEP(X)  is  no  longer  reported  as  a  detector  performance  measure.  It  was  re¬ 
placed  by  its  reciprocal,  $l(\)/Vn,  called  the  spectral  detectivity  D(X),  in  order 
to  report  a  larger  number  when  the  detector  SNR  is  higher.  Detectivity,  in 
turn,  was  replaced  by  a  normalized  quantity  called  specific  detectivity,  defined  by 

™  . 

where  A f  is  the  noise  equivalent  bandwidth  and  D*  is  reported  in  units  of 
cmVHz/W,  so  care  must  be  taken  in  equations  where  the  other  parameters 
are  in  MKS  units. 

Specific  detectivity  bears  a  similar  relationship  to  detectivity  as  that  of 
specific  heat  to  heat  capacity.  Specific  detectivity  is  a  detector  material  prop¬ 
erty,  whereas  detectivity  describes  the  result  of  using  that  material  property 
to  fabricate  a  particular  detector.  The  factor  {AdAf)x/2  is  the  normalization, 
analogous  to  dividing  the  heat  absorbed  by  a  sample  by  its  mass  and  temper¬ 
ature  rise  to  obtain  specific  heat.  It  accounts  for  the  observation  that  in  most 
detectors  the  SNR  is  inversely  proportional  to  the  square  root  of  the  product 
of  detector  area  and  electrical  bandwidth.  Putting  all  this  together,  a  commonly 
seen  form  for  the  SNR  is 

ao  a  r°° 

SNR  =  — “ — (W  -  LeXB)Ta(X)T0(X)D*(X)  d\  .  (1.26) 

(AdAf)/2jo 

At  this  point  blackbody  radiation  is  introduced  for  the  first  time  in  these 
derivations  by  assuming  that  the  spectral  radiance  is  a  function  of  temperature. 
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For  cases  where  detection  of  small  temperature  differences  against  a  uniform 
background  at  temperature  Tb  is  of  interest,  the  approximation  is  made  that 

-jT 

Lexr  -  LekB  =  A T^(Tb)  ,  (1.27) 

where  the  Tb  in  parentheses  indicates  evaluation  of  the  partial  derivative  at 
that  temperature.  The  SNR  equation  then  becomes 

<*pA0  r°°5Lex 

SNR  =  7T-"A^Ar  ~7^(TB)Ta(\)70(\)DH\)  dX  .  (1.28) 

(Adkf)  Jo  dT 

Longshore,  Raimondi,  and  Lumpkin15  made  the  definition 

f  00 

M*  =  7T I  -^(TB)Ta(\)To(\)D*(\)  dX  (1.29) 

and  proposed  its  use  as  a  figure  of  merit  for  spectral  band  selection. 

The  SNR  equation  is  sometimes  further  developed  by  incorporating  the 
theoretically  ideal  form  of  spectral  detectivity  for  a  bandgap  semiconductor 
detector, 


D*(\)  =  D*(kp )  ,  \  «  Xp  ,  (1.30) 

A-p 

where  Xp  is  the  theoretically  sharp  "cutoff”  wavelength  corresponding  to  the 
bandgap.  The  formulation  of  D*  in  energy  units,  with  the  value  of  D*  increas¬ 
ing  with  wavelength,  suggests  the  erroneous  notion  that  longer  wavelengths 
are  more  efficacious  from  a  SNR  viewpoint  than  are  shorter  wavelengths.  In 
fact,  the  response  of  a  photon  detector  at  any  wavelength  is  proportional  to 
the  photon  flux  at  that  wavelength,  not  to  the  energy  flux. 


Photon  Form.  The  photon  counting  SNR  is  derived  from  Eqs.  (1.17)  and  (1.18) 
by  finding  the  change  Arcs  in  the  number  of  signal  carriers  due  to  the  radiance 
difference  between  target  and  background.  That  change  is  then  divided  by  the 
number  of  so-called  "noise  carriers,”  the  square  root  of  the  variance  in  the 
number  of  total  carriers  from  all  sources,  including  noise  sources.  The  variance 
is  assumed  to  equal  the  mean  value  nr  of  the  total  number  of  carriers,  as 
in  Eq.  (1.2). 

Paralleling  Eq.  (1.21),  the  time  rate  of  generation  of  the  spectral  density  of 
the  number  of  signal  carriers  corresponding  to  the  difference  between  signal 
and  background  is  approximately 


dAnxs 


dt 


-  ap AoiLqxr  -  LqkB)Ta(Xho(X)r]q(X)  , 


(1.31) 
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where  %(\)  is  the  quantum  efficiency  as  a  function  of  wavelength,  0  ^  %(\) 
^  1.  The  quantum  efficiency  is  the  efficiency  in  the  conversion  of  photons  to 
signal  carriers,  assuming  the  device  is  not  an  avalanche  structure.  Note  the 
use  of  the  subscript  q  on  the  photon  spectral  radiances. 

Assuming  that  the  detector  is  "on”  and  collecting  photons  for  a  fixed  inte¬ 
gration  time  Tt-  before  it  is  "read  out,”  the  change  in  the  number  of  signal 
carriers  in  an  integration  time,  after  integration  over  all  wavelengths,  is 


r  oo 

Atts  =  a£A0T;  ( LqXT  -  Lq\BhaMT0(\)y\q{\)  dk  . 

Jo 


(1.32) 


Then  the  SNR  is 


SNR 


(1.33) 


The  total  number  of  carriers  arises  from  background,  signal,  and  signal- 
independent  noise  sources  ("dark  current”).  The  components  include  the  noise 
sources  listed  in  Sec.  1.2.1.  It  is  dependent  on  the  device  structure,  and  a  general 
treatment  is  beyond  the  scope  of  this  chapter.  However,  the  fundamental  limit 
due  to  photon  noise  is  derivable  as  follows.  If  the  difference  between  the  target 
and  background  photon  radiances  is  small,  and  if  the  generation  of  noise 
carriers  is  wholly  due  to  background  flux,  then  nr  —  jib,  the  number  of  carriers 
generated  by  background  flux.  If  the  detector  is  perfectly  cold-shielded  so  that 
the  only  background  flux  it  receives  arrives  from  the  scene  through  the  optics, 
then  following  the  approach  of  Borg,  Davis,  and  Thompson16  the  variance  of 
the  number  of  carriers  is 


=  TIT  -  CtpAoTi  f  Lq\{TB)7a(k)lo{k)v\q{k)  dk  . 

Jo 


(1.34) 


Making  the  assumption  that  the  detector  background  is  uniform  at  a  temper¬ 
ature  7b,  the  SNR  is 


SNR 


OtpAoTj  I  ( Lq\T  7'g\B)T’a(^)T0(A)T|g(A)  dk 

Jo 


apA0Tj  f  LfjxiTs)^ 

Jo 


(k)  dk 


Vl 


(1.35) 


This  is  a  highly  idealized  case.  In  general,  it  is  necessary  to  model  the  detector 
fluxes  originating  from  the  atmosphere,  the  optical  elements,  and  the  struc¬ 
tures  around  the  optics  and  the  detector. 


1. 2.5.2  Point  Source  SNR.  Recall  from  Eq.  (1.16)  that  the  change  in  flux 
arriving  at  a  detector  due  to  the  appearance  of  a  point  source  against  a  uniform 
background,  for  either  energy  or  photons,  is  approximately 
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A0 

\d  —  A/\T0(k)  2To(k)jS0(X)  • 

ti 

Energy  Form.  Paralleling  the  derivation  of  the  energy  form  from  Sec.  1.2.5. 1, 
the  point  source  energy  SNR  is  derived  by  writing  the  equation  for  the  spectral 
change  in  signal  voltage  AVS(\),  dividing  it  by  the  noise  voltage  Vn,  and 
integrating  over  all  wavelengths.  The  result  is 

SNR  =  ^  f  A/,xTo(X)to(X)S0(A)^  d\  .  (1.36) 

R2J  o  Vn 


As  before,  NEP(X)  =  Vn/9ft(\),  so 


SNR  =  ^  [  A/eXT0(\)T0(A)S0(X)/NEP(A)  dX  .  (1.37) 

RZJ  o 

Photon  Form.  Paralleling  the  derivation  of  the  photon  form  in  Sec.  1.2.5. 1, 
the  point  source  photon  SNR  is  derived  by  writing  the  equation  for  the  spectral 
change  in  the  rate  of  generation  of  signal  carriers  d/Xns/dt ,  dividing  it  by  the 
square  root  of  the  total  number  of  carriers  from  all  sources,  and  integrating 
over  all  wavelengths.  The  result  is 


SNR 


(\)T0(X)S0(X)Tig(\)  dX  . 


(1.38) 


The  limiting  case  is  given  by  the  background-limited  infrared  photodetection 
(BLIP)  condition  so  that  the  total  number  of  carriers  is  given  by  Eq.  (1.34), 
and  the  theoretical  limit  to  SNR  for  a  small  signal  relative  to  the  background  is 


SNRblip  = 


A0T  i 

~R* 


[  AIq\Ta(X)'T0(X)S0(X)r]q(X)  dX 
JQ 


roc 

A0apTi  LqxiTshaiXhoiX^qiX)  dX 
Jo 


1/2 


(1.39) 


1.2.6  Sensitivity 

Sensitivity  as  used  here  is  defined  as  the  value  of  the  change  in  a  distinguishing 
source  radiant  characteristic  that  equals  the  rms  value  of  the  noise  at  some 
specified  point  in  the  imaging  process.  Therefore,  sensitivities  are  called  noise 
equivalent  parameters.  In  thermal  imaging,  a  commonly  used  noise  equivalent 
parameter  is  the  noise  equivalent  temperature  difference  (NETD)  in  the  am¬ 
plified  detector  output.  In  threat  warning,  a  common  parameter  is  the  noise 
equivalent  irradiance  (NEI)  on  the  collecting  aperture. 

1. 2.6.1  NETD.  NETD  is  a  laboratory  measure  defined5  with  the  assump¬ 
tions  that  the  measurement  sources  are  blackbodies  and  that  the  atmospheric 
transmission  is  unity.  It  is  the  target  A T  against  a  uniform  background  at  Tb 
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that  produces  a  unity  ratio  of  peak  signal  to  rms  noise  when  measured  at  some 
specified  point  in  the  electronic  signal  processing.  The  target  is  sized  suffi¬ 
ciently  large  relative  to  the  system  resolution  such  that  the  system  frequency 
response  does  not  significantly  reduce  the  signal  amplitude. 

NETD  may  be  specified  as  a  minimum  value  to  be  achieved  in  all  detector 
channels  or  as  a  channel  average.  To  be  meaningful,  the  background  temper¬ 
ature,  the  spectral  band,  the  exact  point  of  measurement  in  the  video  chain, 
the  method  of  noise  estimation,  and  the  extent  of  any  external  video  filtering 
must  all  be  specified.  NETD  is  measured,  as  described  by  Driggers  et  al.,17  by 
the  ratio  of  the  noise  voltage  to  the  slope  of  the  curve  of  signal  voltage  AV 
versus  A T  for  small  A T: 


NETD  = 


AV/AT  ’ 


(1.40) 


This  is  so  defined  because  the  signal  transduction  curve  may  have  an  offset 
from  the  origin  due  to  thermal  offsets  in  the  test  equipment,  causing  a  single 
point  signal  measurement  to  be  in  error.  They  also  point  out  that  reporting 
the  NETD  of  multiple  channels  as  a  single  composite  number  by  taking  the 
rms  value  of  all  the  channel  NETDs  is  more  sensitive  to  the  effect  of  a  few 
very  noisy  channels  than  is  reporting  the  average  channel  NETD. 

Even  though  NETD  is  a  simplistic  performance  parameter,  easily  misin¬ 
terpreted  or  misrepresented,  it  is  still  useful  because  it  is  an  absolute  measure 
of  low-frequency  SNR.  As  a  summary  measure  its  order  of  magnitude  is  in¬ 
dicative  of  system  performance,  and  the  equations  for  more  complicated  per¬ 
formance  measures  can  often  be  cast  in  forms  that  include  NETD  as  a  con¬ 
venient  factor. 

Energy  Form.  The  energy  form  of  the  NETD  equation  is  derived  from  Eq. 
(1.28)  by  setting  the  Ta(X)  term  to  unity,  setting  SNR  equal  to  unity,  solving 
for  AT,  and  identifying  the  result  as  NETD: 

(ArfA/)1/2 

NETD  =  AT(SNR  =  1)  = - - - -  .  (1.41) 

ap  Jo  -^(7b)t„(\)D*(\)  d\ 

For  the  case  of  a  circular  aperture  and  using  Eq.  (1.13),  you  will  often  see  Eq. 
(1.41)  rewritten  as 


NETD  = 


4(/y#)VAf 

f°°dZ/ 

WTd  Jq  -~(TB)r„(X)DH\)  dK 


(1.42) 


Recall  that  this  is  an  approximation  for  large  /7#’s. 

Equations  (1.41)  and  (1.42)  are  applicable  whenever  the  spectral  form  ofD* 
is  known.  Most  often  that  is  not  the  case,  the  D*  being  reported  by  the  man¬ 
ufacturer  as  either  theD*(\p)  or  theD*(500).  The  latter  is  an  effective  quantity 
integrated  over  a  specified  spectral  bandpass  by  measurement  with  a  blackbody 
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at  500  K  as  the  chopped  source  and  a  blackbody  at  300  K  as  the  chopping 
background.  Note  that  this  is  not  the  same  as  the  "blackbody”  D*  defined  by 
Dereniak  and  Crowe.2 

A  further  complication  is  that  a  .D*(300)  often  is  cited  because  with  its  use 
the  NETD  equation  may  be  written  without  a  spectral  integral.  That  form  is 
derived  by  noting  that  Eq.  (1.41)  contains  the  following  integral  in  its 
denominator: 


f 


^(TbM\)D*(K)  dX 


(1.43) 


The  first  step  in  this  conversion  is  to  assume  the  background  temperature  is 
300  K.  Then  the  integral  is  replaced  by  measurable  spectrally  integrated  quan¬ 
tities.  An  "effective”  optical  transmission  t0  is  sifted  out  of  the  integral: 


rdLeX 

Jo  ST 


(300  K)t0(X)D*(X)  dX 


To 


raL,x 
Jo  ST 


(300  K )D*(X)  dX 


(1.44) 


Then  the  original  integral  is  rewritten  as: 


Jro°dL  rdL 

—^(300  K)t o(X)D*(X)  dX  =  To  -^(300  K )D*(X)  dX  .  (1.45) 

o  oi  Jo  01 

Then  the  integral  on  the  right  side  of  Eq.  (1.45)  is  used  to  sift  out  the  D*(300) 
defined  by: 

Jrcc  dL 

—^(300  K)D*(X)  dX 
0  01 

£*(300)  =  - -  .  (1.46) 

f  ~~(300  K)  dX 
Jo  01 


Assuming  Lambertian  behavior  and  rearranging  Eq.  (1.46)  we  get 

—£(300  K)D*(A)  d\  =  DH 300  K)-  -#(300  K)  d\  .  (1.47) 

0  dT  TrJo  ol 

Recognizing  that  the  integral  on  the  right  side  of  Eq.  (1.47)  is  the  thermal 
derivative  of  the  Stefan-Boltzmann  law  evaluated  at  300  K, 


/: 


°d_MeX 

ST 


(300  K)  dX  =  4ae(300  K)1 


(1.48) 


we  rewrite  Eq.  (1.47)  as 
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J^OO'jT  -j 

-^(300  K)D*(k)  dk  =  —  4ae(300  K)3D*(300)  .  (1.49) 

0  dT  t r 

Then  replacing  integral  (1.43)  by  the  product  4ac(300  K)3to£)*(300)/t7,  the 
NETD  equation  becomes: 


NETD  = 


77(ArfAf)1/2 

4ue(300  K)3apToD*(300)  ' 


(1.50) 


Again  Eq.  (1.13)  may  be  employed  to  produce  the  simplest  possible  approximate 
NETD  equation, 


NETD  = 


VA>e(300  K)3toD*(300)  ' 


(1.51) 


As  a  numerical  example,  consider  a  noninterlaced  scanning  FLIR  with  a  4:3 
aspect  ratio  and  a  linear  contiguous  480-element  detector  array.  Let  this  FLIR 
use  sampled  integrating  detectors  at  a  30-Hz  frame  rate  with  a  scan  efficiency 
of  75%,  and  let  the  number  of  samples  per  detector  dwell  time  be  1.5,  yielding 
960  samples  per  scan  line.  Let  the  detector  integration  time  equal  the  sample 
interval,  so  that  the  noise  bandwidth  A f  =  1/(2t;)  =  (30  Hz)  (960  samples/ 
line)/[2(0.75)]  =  19.2  kHz. 

Let  the  /7#  be  2,  the  square  root  of  the  detector  area  be  0.0025  cm,  the 
optical  transmission  be  0.75,  and  the  D*(300)  be  2  x  1010  cm\/Hz/W.  Then 
the  NETD  is  calculated  to  be 


NETD  = 


_ 22(19.2  kHz)1/2 _ 

(0.0025  cm)(5.67  x  10-12  W  cm  J^K~4)(300  K)3 
x  (0.75)(2  x  1010  cm\/Sz/W) 


=  0.097  K  . 


With  the  NETD  formulated  in  this  way,  the  effective  optical  transmission  t0 
can  be  measured  by  the  insertion  loss  method  with  small  signals  and  the 
detector  of  interest,  which  is  exactly  the  definition  of  t0,  and  the  Z>*(300)  can 
be  measured  with  small  signals  in  a  test  set  having  the  same  spectral  shape 
as  t0 (X).  In  practice,  the  detector  is  usually  measured  by  the  difference  between 
a  300  K  source  and  a  500  K  source,  and  the  resulting  D*(500  K)  is  converted 
to  the  desired  D*(300)  by 


D*(300)  =  D*(500) 


(500  K)4  -  (300  K)" 


JC 


4(300  K)3 

S 

D*(\)-^( 300  K)  dk 
01 


i: 


D*(k)[Le\( 500  K)  -  L«,x(300  K)]  dk 


x 


(1.52) 
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The  effective  quantities  of  Eqs.  (1.44)  and  (1.46)  were  sifted  out  of  their  home 
integral  in  the  order  given  so  that  when  they  are  measured  their  product  will 
have  the  same  value  as  the  integral.  Therefore,  they  are  not  necessarily  the 
same  as  the  ''apparent”  or  "average”  quantities  defined  in  Sec.  1.2.7,  which 
are  used  to  collect  experimental  data  at  the  system  level. 

The  fundamental  limit  to  NETD  is  derived  by  substituting  the  D*  expression 
for  BLIP  performance.  The  BLIP  condition  is  attained  when  the  detector  noise 
is  dominated  by  the  random  absorption  rate  of  background  photon  flux,  for 
example,  by  generation  noise  in  a  photodiode  or  other  charge  separation  struc¬ 
ture,  or  by  generation-recombination  noise  in  a  photoconductor. 

In  the  photodiode  case,  the  D*(X)  for  the  BLIP  condition  is  given  by 


D  blipGO  = 


X  T)q(X) 

W 2  ( EqB)v 2 


T\q00 


hcV 2 


—  %(X)tc/-(X)E9\b  d\ 

7T  JO 


1/2 


(1.53) 


where  E9b  is  the  spectrally  integrated  photon  irradiance  on  the  detector  from 
a  full  hemispherical  surround,  ^(X)  is  the  spectral  quantum  efficiency,  DCs  is 
the  effective  solid  angle  to  which  reception  of  background  irradiance  is  limited 
by  a  cold  shield  (if  any),  and  tc/*(X)  is  the  transmission  of  a  background-reducing 
cold  filter,  if  used.  For  a  photoconductor,  in  most  cases,  the  factor  V2  in  the 
denominator  of  Eq.  (1.53)  is  replaced  by  the  factor  2  due  to  the  presence  of 
recombination  noise  having  the  same  PSD  as  the  generation  noise. 

Insight  into  the  design  implications  of  BLIP  operation  is  achieved  as  follows. 
First  define  D  blip  as  the  D  blip  for  an  unshielded  detector,  that  is,  one  having 
a  cold  shield  solid  angle  of  tt.  Then,  since  the  background  photon  flux  is  pro¬ 
portional  to  the  solid  angle,  and  D*  is  inversely  proportional  to  the  inverse 
square  root  of  the  solid  angle, 


Drlip  =  ('it/Dcs)1/2Dblip  .  (1.54) 

Then  let  the  perfect  cold  shield  solid  angle  conforming  to  the  cone  of  flux 
converging  on  the  detector  be  ttp.  Next,  define  a  cold  shielding  efficiency  r\cs 
by  the  ratio  of  flp  to  the  actual  cold  shield  solid  angle  flcs  so  that: 

ftos  =  —  ■  (1-55) 

Tics 

Then  Eq.  (1.41)  may  be  rewritten  for  the  BLIP  condition  per  Laakmann18  or 
Lloyd5  as 


NETDblip  ” 


_ (Ad&f)1/2 _ 


(1.56) 
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For  the  common  case  where  the  cone  of  irradiance  converging  toward  the 
detector  is  circular,  and  the  optical  fl#  is  slower  than  /72,  a  satisfactory  ap¬ 
proximation  to  the  perfect  cold  shield  angle  is 


7T  _  T tDo 

(2/y#)2  _  ' 


(1.57) 


Substitution  of  Eq.  (1.57)  into  Eq.  (1.56)  followed  by  some  manipulation  yields 


2fVKf 

NETDblip  - - - ' -  , 

ir VA~dD0V^7s  -t£(Tb) t„(X)Z)S£ip(X)  dX 
Jo 


(1.58) 


showing  the  key  result  that  BLIP  NETD  depends  on  D0  to  the  inverse  first 
power.  Barhydt19  provides  a  formalism  for  describing  nearly  BLIP  detectors 
and  in  a  subsequent  paper20  gives  a  derivation  similar  to  the  above  but  for 
nearly  BLIP  conditions. 

Photon  Form.  The  photon  form  of  the  NETD  equation  is  derived  from  Eqs. 
(1.32)  and  (1.33)  by  dropping  the  tq(X)  term,  making  the  small-signal  approx¬ 
imation  as  in  Eq.  (1.27),  setting  SNR  equal  to  unity,  solving  for  AT,  and 
identifying  the  result  as  NETD: 

NETD  =  - jz— - - -  .  (1.59) 

ot|3A0T;  -=£ (TB)ro(X)r\g(X)  d\ 

Jo  dl 

Using  the  result  of  Eq.  (1.35)  the  BLIP  limit  may  be  rewritten  as 


NETDblip  = 


_  0 


1/2 


Lq\{TB)T]qW  dk 


(apA0Tt) 


,,-f 

Jo 


dLq\ 

dT 


(TBho(k)r\q(k)  dk 


(1.60) 


1.2. 6.2  NEI.  The  noise  equivalent  irradiance  (NEI)  is  the  value  of  the  ir¬ 
radiance  in  the  plane  of  the  optical  entrance  aperture  that  produces  a  unity 
SNR  in  the  detector  output.  This  is  also  called  noise  equivalent  flux  density 
(NEFD).  It  is  used  primarily  as  a  figure  of  merit  for  point  source  detection 
systems.  It  is  derived  as  follows.  Let  Ee\0  be  the  irradiance  from  a  point  source 
on  an  aperture  of  area  A0.  Accounting  as  in  Sec.  1.2.4  for  an  optical  trans¬ 
mission  t0(X)  and  a  detector-to-image  coupling  shape  factor  S0(k),  the  spectral 
SNR  is 


SNR(X)  = 


EeXoA0T0(k)So(k) 

NEP(X) 


Ee\oA0T0(k)S0(k)D*(k) 

(AdA/)I/2 


(1.61) 
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Integrating  over  all  wavelengths, 
A 


SNR  = 


ro 

k) _ 

\f)1/2Jo 


EeXoT0(k)S0(k)D*(k)  dk  . 


(AdAfY 

Defining  the  average  in-band  aperture  irradiance  as 


Eeo  — 


f 

Jo 


WmOOD*(W  dk 


f 

JO 


T0(k)S0(k)D*(k)  dk 


(1.62) 


(1.63) 


Eq.  (1.62)  may  be  rewritten  as 

SNR  =  7  r I  r0(k)S0(k)D*(k)  dk  .  (1.64) 

(AdAf)/2Jo 

Setting  the  SNR  equal  to  one,  solving  for  Eeo  and  identifying  it  as  NEI, 


NEI  =  Eeo  (SNR  =  1)  = 


[AdAfll 

A0\  T0(k)S0(k)D*(k)  dk 
Jo 


(1.65) 


Barhydt14  shows  that  the  extension  of  NEI  to  include  the  electrical  signal 
processing  requires  the  addition  of  a  correction  factor  accounting  for  the  peak- 
to-peak  amplitude  response  of  the  electronics  to  the  specific  shape  of  the  de¬ 
tector  output  waveform  for  the  source.  He  called  this  the  electrical  efficiency 
or  pulse  gain  factor.  Barhydt21,22  extended  the  simple  formulation  given  above 
to  the  case  of  near-BLIP  conditions. 

It  is  common  practice  to  describe  a  point  source  by  its  average  in-band 
radiant  intensity  A/ax,  relative  to  the  background,  in  watts  per  steradian  as 
measured  by  integration  over  a  specified  spectral  band  for  specific  atmospheric 
conditions: 


[  Mkja(\,R)  dX 
Jax 

A/ax  =  —{ -  ,  d-66) 

T a(\,R)  d\ 

Ja\ 

where  t a(X,R )  is  the  atmospheric  transmission  for  a  specific  range  R.  Deriving 
the  A/ax  for  other  ranges  and  atmospheric  conditions  obviously  is  subject  to 
error  given  only  an  average  A/ax  for  another  set  of  conditions  as  a  starting 
point.  However,  this  problem  is  unavoidable  if  a  spectral  shape  is  not  specified. 
A  photon  form  of  NEI  could  be  defined  paralleling  the  derivation  given  above, 
but  it  would  not  be  useful  because  point  source  data  customarily  are  reported 
in  energy  units. 
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1.2.7  Apparent  Quantities 

Section  1. 2.6.1  defined  an  "effective”  or  "blackbody”  optical  transmission  useful 
for  simplifying  the  form  of  the  NETD  equation.  This  is  different  from  the  usual 
definition  of  an  "apparent”  or  "average”  or  "in-band”  optical  transmission 
useful  in  reporting  the  results  of  experiments.  For  example,  it  is  useful  to  make 
generalizations  such  as  the  following: 

•  "The  atmospheric  transmission  varied  between  40  and  50%. ” 

•  "The  optical  transmission  degraded  by  1%  per  degree  C.” 

•  "The  apparent  delta-T  was  10  degrees  C.” 

Such  simplifications  are  made  by  calculating  these  apparent  quantities  by  the 
insertion  loss  method.  The  variation  in  effective  quantities  is  what  we  infer 
from  measurements  made  over  a  spectral  band  without  benefit  of  spectral 
discrimination  inside  that  band.  Recalling  Eq.  (1.21)  and  integrating  over  all 
wavelengths,  the  change  in  signal  determined  by  two  measurements  of  sources 
at  different  temperatures  is 


AV  =  JQ  AV00  d\  = 


[ Ut(Tt )  -  L\b ( Tb )]t0 (\)t0(\)9WX)  d\  .  (1.67) 


Then  the  apparent  change  in  target  radiance  is  defined  as 

rcc 

J  [Lxt(Tt)  -  Lxb(Tb)]t0(X)t0(XWX)  d\ 

A  La  =  - - P -  ,  (1.68) 

t0(X)t0(X)S/UX)  dX 
Jo 


the  apparent  atmospheric  transmission  as 


Taa 


I 


IUt(Tt) 


L\B(TB)]'Ta(X)'T0(X)<dl(X)  d\ 


[ L\t(Tt ) 


L\b(Tb)]'t0(X)91(X)  d\ 


the  apparent  optical  transmission  as 


(1.69) 


f 

Jo 


[L\t(Tt)  -  £\B(TB)]Ta(X)T0(X)2ft(X)  d\ 


Toa  — 


f 


[Lxt(Tt)  -  LM}(TB)]Ta(m(k)  d\ 


(1.70) 


and  an  apparent  responsivity  as 
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f 


[ L\t(Tt )  -  L\£(TB)]Ta(X)T0(X)Sft(X)  dX 


rz 

-0 


[L\t(Tt) 


L\b(Tb)]to(X)t0(X)  dX 


(1.71) 


In  general,  however, 

V  apAoALaTaaToa^a  (1.72) 

because  the  apparent  quantities  were  not  successively  sifted  out  of  Eq.  (1.68) 
like  the  effective  quantities  of  Eqs.  (1.44)  and  (1.46). 

For  Tt  ~  Tb  on  the  order  of  a  few  degrees  kelvin,  an  apparent  AT  can  be 
calculated  by  defining  the  apparent  change  in  signal  with  a  small  change  in 
temperature  as 

H  =  a pAoJ0  ^r^T0(\)T o(X)m)  d\  .  (1.73) 


Dividing  Eq.  (1.68)  by  Eq.  (1.73)  we  get  the  apparent  AT: 


ATa 


AV 

dV/dT 


f 


[L\t(Tt)  -  L\B(TB)ha(Xh0{X)(3l(\)  dX 


•a 

•0 


dLk(TB ) 
dT 


(1.74) 


Ta(X)T0(X)^(X)  C/X 


Note  that,  in  general,  this  is  not  necessarily  the  same  as  the  actual  blackbody 
temperature  difference. 


1.2.8  Spectral  Band  Selection 

The  determination  of  which  spectral  band  maximizes  the  SNR  depends  on  the 
spectral  natures  of  the  atmospheric  transmission,  of  the  optical  transmission, 
and  of  the  detector  quantum  efficiency.  Dependencies  of  noise  on  the  spectral 
band  are  also  a  consideration,  as  in  the  case  of  spectrally  cold-filtered  BLIP 
performance. 

Longshore,  Raimondi,  and  Lumpkin15  presented  examples  of  spectral  band 
trade-offs  for  the  case  where  the  threshold  of  target  detection  is  set  by  small 
temperature  differences.  They  expressed  the  spectrally  dependent  quantities 
in  the  NETD  equation  by  the  radiation  function  M*  given  by  Eq.  (1.29)  in  Sec. 
1.2.5.  Their  examples  used  the  LOWTRAN  model  for  atmospheric  transmission 
and  assumed  unity  optical  transmission,  blackbody  targets,  and  constant  quan¬ 
tum  efficiency  in  the  spectral  band. 

Findlay  and  Cutten13  presented  a  more  general  method,  appropriate  for  any 
conditions,  but  required  for  ranges  and/or  atmospheres  such  that  large  AT’s 
determine  the  limits  of  detectability.  Although  their  equations  are  too  complex 
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to  reproduce  and  explain  here,  it  is  important  to  note  that  their  approach  is 
required  for  cases  in  which: 

•  the  combination  of  background  and  atmosphere  may  not  be  a  blackbody, 
as  in  the  case  of  high  elevation  angle  lines  of  sight  to  the  sky 

•  measured  D*(Tb)  values  are  not  available  for  the  apparent  background 
temperature  of  interest 

•  the  background  radiance  is  spectrally  different  from  that  of  the  target 

•  the  SNR  threshold  crossover  in  the  comparison  of  two  candidate  spectral 
bands  occurs  at  high  A7”s 

•  sources  of  detector  background  flux  from  the  target  background,  the 
atmosphere,  and  the  optics  must  be  considered  separately. 

Findlay  and  Cutten  argue  that  the  M*  approach  to  spectral  band  selection  is 
appropriate  only  when  a  near-ambient  blackbody  target  is  viewed  against  an 
ambient  blackbody  background  through  a  ground-level  horizontal  path. 

Kleinhans23  proved  that  the  ideal  spectral  filter  has  either  unity  or  zero 
transmission  at  every  wavelength.  An  intuitive  justification  is  as  follows.  It 
is  likely  that  the  combination  of  source  signature  and  atmospheric  transmis¬ 
sion  has  a  maximum  and  is  relatively  flat  over  a  certain  narrow  waveband, 
and  that  optical  and  detector  materials  can  be  found  to  match  that  band.  This 
narrow  band  is  taken  as  the  starting  point  for  an  optimization. 

The  exact  limits  of  the  optimum  band  can  be  investigated  by  eliminating  a 
very  narrow  waveband  from  the  starting  passband.  If  elimination  of  this  nar¬ 
rower  band  increases  the  integrated  SNR,  it  should  be  left  out.  Otherwise,  it 
should  be  kept.  Likewise,  expansion  of  the  limits  of  the  passband  can  be  de¬ 
termined  by  adding  a  narrow  waveband.  The  optimum  passband  is  then  found 
by  iteration. 

As  an  example,  one  of  the  perennial  problems  of  terrestrial  thermal  imaging 
is  the  choice  between  the  3-  to  5-fim  and  the  8-  to  12-|jLm  atmospheric  windows. 
That  choice  should  be  based  on  a  tailoring  of  the  problem  at  hand  to  the 
generalized  analysis  procedure  of  Findlay  and  Cutten.13  In  general,  the  8-  to 
12-fjim  range  is  preferred  unless  some  shorter  wavelength  characteristics  such 
as  exhaust  plumes  or  sun  glints  are  of  particular  interest. 

The  cases  analyzed  by  Findlay  and  Cutten  indicate  that  the  8-  to  12-jxm 
window  is  superior  to  the  3-  to  5-|mm  window  at  all  ranges  of  tactical  interest, 
unless  the  targets  are  very  hot  and  ranges  of  tens  of  kilometers  are  required. 
The  availability  of  detector  arrays  with  selectable  or  simultaneous  dual-color 
response  offers  the  best  of  both  bands  with  a  modest  increase  in  design  com¬ 
plexity  for  circumstances  where  there  is  no  clear  advantage  for  either  band. 


1.3  CLUTTER  NOISE 

The  experience  of  looking  right  at  something  and  not  seeing  it  is  a  common 
one:  Your  ears  can  guide  you  to  look  at  a  bird  calling  from  a  tree,  but  you  may 
not  be  able  to  distinguish  it  within  the  clutter  of  branches  and  leaves.  The 
experiential  definition  of  clutter  is  that  it  consists  of  variations  in  the  back¬ 
ground  having  about  the  same  size,  radiant  exitance,  and  texture  of  the  source 
you  are  searching  for.  Clutter  consists  of  scene  elements  similar  enough  in 
size  and  contrast  to  the  sources  sought  that  each  one  has  to  be  considered  in 
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detail  as  a  potential  target.  In  heavy  clutter  you  need  enough  sensor  resolution 
to  delineate  clearly  straight  lines  on  targets.  Typically  this  means  more  than 
twice  as  much  resolution  than  is  needed  without  clutter.  Clutter  can  be  so 
strong  that  no  amount  of  improvement  in  the  SNR  will  reduce  the  search  time 
to  find  the  target,  although  resolution  improvement  might  help. 

1.3.1  Description 

Mathematically,  clutter  is  described  by  the  variance  of  the  scene  radiant  ex- 
itance  after  removal  of  low-frequency  content  such  as  the  mean  value  and  any 
slowly  varying  trends,  and  by  the  correlation  lengths  in  the  two  angular  di¬ 
mensions  in  the  orientation  in  which  the  scene  is  viewed. 

Itakura,  Tsutsumi,  and  Kakagi24  observed  that  the  statistics  of  scenes  dom¬ 
inated  by  thermal  emission  tend  to  exhibit  a  random  distribution  of  radiance 
which  is  Gaussian: 

P(L)  =  =  expt  -  (L  -  L)2/2<t2]  ,  (1.75) 

aA/27 r 

where  L  is  the  radiance  of  an  element  of  the  scene,  L  is  the  average  scene 
radiance,  and  a2  is  the  variance  of  the  scene  radiance. 

They  also  observed  that  strongly  reflective  scenes  with  a  relatively  few 
highly  impulsive,  high-amplitude  components  tend  to  exhibit  Poisson  statistics: 

P(L)  =  iexp(— L/C)  ,  (1.76) 

c 

where  C  is  the  mean  and  square  root  of  the  variance. 

Scene  amplitude  statistics  can  also  be  a  combination  of  the  Gaussian  and 
the  Poisson: 


P(L)  = 


exp(cr2/2 C2)  exp[  —  (L  -  L)/C] 


VttC 


*  erfc(^c  ■  \ m )  ■ 


where  the  complementary  error  function  is  given  by 
erfc(x)  =  [  exp(-t2)dt  . 


(1.77) 


(1.78) 


The  spatial  autocorrelation  function  tends  toward  the  simple  form 

P(r)  =  aexp(-ar)  ,  (1.79) 

where  r  is  the  separation  of  any  two  points  and  a  is  the  reciprocal  of  the 
average  pulse  width,  that  is,  the  reciprocal  of  the  background  correlation  length. 
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The  PSD  combining  both  amplitude  and  spatial  characteristics  as  derived 
by  Ben- Yosef,  Rahat,  and  Feigen25  for  zero  mean  amplitude  is  given  by 


PSD  (fx,fy)  = 


2iTao-2 

a2  +  (2n/,)2  +  (2u/v): 


(1.80) 


where  fx  and  fy  are  spatial  frequencies  in  cycles  per  linear  dimension. 

For  the  thermal  infrared,  Ben- Yosef,  Rahat,  and  Feigen25  observed  that 
where  scene  temperature  variations  are  small,  say  about  ±  10°C  about  an 
average  temperature  (T),  the  radiation  functions  are  approximately  linear  in 
A  T  so  that 


P(T)  =  — —  exp 


( T  -  (T)): 


(1.81) 


where  cr2  is  the  variance  of  T. 

Ator  and  White26  concluded  from  comparisons  of  spatially  registered  in¬ 
frared  and  visible  scene  data  that  anisotropic  power  spectral  densities  are 
common  due  to  the  presence  of  geological  features  and  cloud  structures.  Thus 
a  scene  may  not  always  be  describable  by  a  one-dimensional  PSD. 

Ben  Yosef  et  al.27-36  made  critical  contributions  to  the  understanding  of 
clutter  and  clutter  statistics  in  the  thermal  infrared.  They  found  that  the 
measured  statistics  of  IR  scenes  depend  on  the  spatial  resolution  of  the  thermal 
imager  used  to  make  the  observations  because  the  imager  resolution  may  be 
averaging  over  many  smaller  independent  scene  elements.  They  also  found 
that  although  the  scene  statistics  as  measured  by  a  high-resolution  imager 
may  be  non-Gaussian,  averaging  by  a  lower  resolution  imager  will  tend,  con¬ 
sistent  with  the  central  limit  theorem,  to  produce  Gaussian  statistics. 

Extreme  care  must  be  taken  in  the  calculation  and  interpretation  of  PSDs 
to  avoid  deceptive  results  arising  from  the  inclusion  of  low-frequency  scene 
components.  Scenes  commonly  contain  slowly  varying  gradients  where  the 
amplitude  of  the  gradient  greatly  exceeds  the  amplitudes  of  the  superimposed 
informative  variations.  Large  abrupt  transitions  are  also  common,  as  in  the 
boundaries  between  ground  and  sky,  between  earth  and  water,  or  between  sky 
and  clouds. 

In  such  cases  the  Fourier  transform  of  the  autocorrelation  function  will  be 
dominated  by  the  contribution  of  such  features,  and  use  of  such  a  PSD  will 
overestimate  the  masking  effects  of  clutter.  Therefore,  it  is  necessary  in  most 
cases  to  remove  large  uniform  trends  and  abrupt  transitions  from  the  scene 
data  prior  to  calculating  the  PSD.  Similarly,  before  using  published  PSD  re¬ 
sults,  the  method  of  calculation  must  be  checked. 


1.3.2  Diurnal  Variation 

Collectively,  the  papers  of  Ben-Yosef  et  al.24’27-36  made  four  key  observations 
about  PSDs.  First,  the  dominant  factors  are  variations  in  the  heat  capacity, 
thermal  conductivity,  and  solar  irradiation  absorption  of  the  terrain.  Second, 
in  the  presence  of  solar  heating,  variations  in  scene  emissivity  are  not  impor¬ 
tant  because  the  emissivity  of  natural  ground  materials  typically  is  greater 
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than  0.9.  Third,  as  insolation  increases,  the  standard  deviation  increases,  and 
the  correlation  length  decreases.  Fourth,  terrain  features  that  are  unobserv¬ 
able  in  steady-state  conditions  may  become  apparent  during  warming  or  cool¬ 
ing  transients. 

They  wrote  a  heat  balance  equation  accounting  for  heat  capacity,  thermal 
conductivity,  thermal  radiation,  absorption,  and  insolation.  Experiments  val¬ 
idated  this  equation  for  the  case  of  dry,  still  summer  desert  terrain.  It  rea¬ 
sonably  accurately  predicts  observed  washouts  and  contrast  reversals,  and 
leads  to  approximately  Gaussian  amplitude  statistics.  The  equation  predicts 
the  skewing  of  the  distribution  observed  under  extreme  conditions.  The  spatial 
autocorrelation  is  predictable  from  the  insolation,  with  the  correlation  length 
decreasing  as  insolation  increases. 


1.3.3  Effects 

Scene  clutter  has  three  major  effects  on  target  detection.  First,  when  the  den¬ 
sity  of  clutter  is  low  and  the  size  and  intensity  of  the  clutter  mimic  the  ap¬ 
pearance  of  the  target,  there  is  a  drastic  slowing  of  search  speed  because  each 
candidate  target  must  be  considered  individually.  A  classic  infrared  example 
is  sagebrush  in  the  desert.  Second,  when  the  density  of  clutter  is  high  and  the 
PSD  mimics  that  of  sensor  noise,  masking  the  target,  there  is  a  reduction  in 
the  conspicuity  of  targets  with  consequent  slowing  of  search  speed. 

Third,  in  automatic  moving  target  detection  using  frame-to-frame  differ¬ 
encing,  the  motion  of  the  sensor  between  frames  produces  the  appearance  of 
motion  in  a  large  percentage  of  the  scene  elements.  This  can  result  from 
platform  motion,  scene  motion,  or  platform  jitter,  and  generates  false  tracks 
in  the  motion  detection  processing.  Weathersby  and  Schmieder37  defined  a 
signal-to-clutter  ratio  and  showed  how  detection  requirements  for  spatial  res¬ 
olution  may  vary  over  a  range  of  ten-to-one  depending  on  the  clutter.  Pohlman38 
showed  how  to  combine  the  effects  on  performance  of  noises  due  to  background 
clutter,  scintillation,  photon  statistics,  and  the  detector. 


1.4  SPATIAL  FREQUENCY  RESPONSE 

Imaging  has  a  fundamental  limit  to  the  size  of  the  smallest  angular  detail 
that  can  be  distinguished,  called  the  resolution.  There  are  three  main  reasons 
for  this.  First,  all  of  the  light  collected  from  a  mathematical  point  in  the  scene 
is  not  imaged  at  a  single  point  in  the  image,  due  to  the  blurring  effects  of 
diffraction,  geometrical  aberrations,  and  scattering.  Second,  atmospheric  scin¬ 
tillation  causes  disturbances  in  the  LOS  to  a  point  in  the  scene.  Third,  the 
light  sensing  element  is  not  a  point,  but  is  extended,  so  that  spatial  integration 
causes  light  from  any  point  in  the  scene  to  be  affected  by  the  responses  to 
adjacent  scene  points. 

The  resolution  of  a  system  may  be  described  and  analyzed  using  either  of 
two  approaches.  One  approach  is  to  write  the  integrodifferential  equations 
that  describe  the  effects  of  each  resolution-limiting  phenomenon  moving  suc¬ 
cessively  from  input  to  output.  The  result  is  a  superposition  integral39: 
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I(x,y)  =  ff  J(^)S[b{x  -  m (y  -  Ti)]  dZ  dv  ,  (1.82) 

where  I(x,y)  describes  the  image  amplitude  variation,  describes  the  ob¬ 
ject  or  source  amplitude  variation  in  the  dummy  variables  £  and  tj,  8(jc  -  £)8 
( y  -  t\)  is  an  ideal  point  source  at  the  variable  point  (£,in),  and  the  function  S 
is  the  system  response  to  that  impulse,  called  the  impulse  response. 

The  second  approach  is  applicable  if  the  superposition  process  behaves  suf¬ 
ficiently  like  a  convolution  to  permit  the  use  of  transform  theory.  In  that  case 
a  series  of  cascaded  independent  convolutionary  imaging  processes  transforms 
to  a  series  of  multiplied  frequency  responses.  Frequency-domain  analysis  or¬ 
dinarily  is  simpler  mathematically  and  yields  more  insight  into  the  imaging 
process. 


1.4.1  Linear  Filter  Theory 

Linear  filter  theory  is  the  application  of  frequency  transforms  to  convolutionary 
spatiotemporal  processes.  It  is  useful  for  determining  the  response  to  specific 
signals  (especially  periodic  ones),  for  predicting  resolution,  and  for  designing 
and  evaluating  image  enhancement  processes.  When  a  system  is  linear  a  sine- 
wave  input  produces  a  sine-wave  output.  This  is  the  reason  Fourier  transform 
analysis  is  used  to  decompose  the  inputs  and  outputs  of  a  linear  system  into 
sine  waves.  Goodman39  provides  an  excellent  introduction  to  this  subject.  Its 
application  to  thermal  imaging  systems  is  given  in  Lloyd.5 

Three  conditions  must  hold  for  linear  filter  theory  to  be  applicable.  First, 
the  processes  must  be  linear.  Second,  they  must  be  stationary  over  a  sufficiently 
large  span  of  time  and/or  space,  called  an  isoplanatic  patch,  to  be  meaningfully 
applicable.  Third,  the  imaging  processes  must  be  single-valued  mappings  of 
input  points  to  output  points,  which  implies  that  they  are  deterministic  and 
effectively  noise  free. 

The  superposition  integral  indicates  that  the  image  of  a  source  point  is  the 
sum  of  the  responses  of  the  system  to  that  point  and  to  all  the  surrounding 
points.  For  the  condition  of  spatial  invariance,  the  superposition  integral  re¬ 
duces  to  a  convolution  integral: 

I{x,y)  =  f  j  j(i-r])r(x  -  £,y  -  -r,)  d^  =  G(x,y)*Hx,y)  ,  (1.83) 

where  r(x  -  £,  y  -  T))  is  the  reverted  point  source  response  (impulse  response) 
of  the  system.  See  Refs.  39  and  5  for  the  derivation  of  this  equation. 

Two  types  of  transforms  may  be  used  depending  on  the  nature  of  the  process 
to  be  described.  If  the  process  occurs  in  an  analog  electrical  circuit  using  a 
real-time  data  stream,  the  realizability  requirement  dictates  that  there  can 
be  no  output  before  there  is  an  input.  Then  the  single-sided  Laplace  transform 
must  be  used,  in  which  only  the  data  appearing  before  the  point  in  time  under 
consideration  influence  the  response  at  that  time.  If  the  process  occurs  in  an 
optical  device  or  in  a  software  computation  working  on  stored  data,  the  Fourier 
transform  is  appropriate. 
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1.4.2  System  Optical  Transfer  Function 

The  optical  transfer  function  (OTF),  or  frequency  amplitude  and  phase  re¬ 
sponse,  of  a  complete  imaging  system  is  the  Fourier  transform  of  its  impulse 
response  r(x,y).  This  clearly  is  not  properly  defined  if  the  impulse  response  is 
significantly  affected  by  nonlinearities  or  noise,  or  if  there  are  residual  sam¬ 
pling  effects  in  the  image.  This  means  that  strictly  speaking,  Fourier  transform 
analysis  only  approximates  the  behavior  of  most  electronic  imaging  devices. 
The  one-dimensional  Fourier  transform  is 


•00 

f{ ;©(*)}  = 

J  — c 


0(x)  exp(  -  2'nixfx)  dx  =  €(fx) 


(1.84) 


and  the  inverse  transform  is 

■F-1{Ci(/i)}  =  6(fx)  exp(2-nixfx)  dfx  =  6(x)  .  (1.85) 

By  the  convolution  theorem,39  in  one  dimension  the  transform  of  the  image  is 

F{€(x)*r(x)}  =  €(fx)Hfx)  (1.86) 

and  the  transform  of  the  impulse  response  is  defined  as 

Hfx)  =  OTF (/,)  -  MTF (fx)  exp[iPTF(/i)]  .  (1.87) 

The  modulus  of  the  OTF  is  called  the  modulation  transfer  function  (MTF) 
and  describes  the  amplitude  response  to  sine-wave  inputs.  The  argument  of 
the  OTF  is  called  the  phase  transfer  function  (PTF)  and  describes  the  phase 
response.  Phase  shifts  are  evidenced  by  asymmetry  of  the  impulse  response 
or,  in  the  case  of  linear  phase  shift,  by  spatial  translation  of  the  center  of 
the  impulse  response  relative  to  the  point  source  input.  If  all  the  processes 
of  an  imaging  system  are  separable,  that  is,  uncoupled  and  independent, 
then  the  system  transfer  function  MTFS  is  the  product  of  the  n  component 
transfer  functions  MTF;: 

MTFS  =  f\  MTF;  .  (1.88) 

i=i 

Following  the  notation  of  Schade,40  the  MTF  is  denoted  by  r  in  lengthy  equations. 

There  is  no  single  ideal  shape  for  the  MTF  of  a  system  whose  output  is  to 
be  viewed  by  a  human.  Kusaka41  showed  for  high-definition  television  imagery 
that  the  MTF  that  produces  the  most  aesthetically  satisfying  picture  depends 
on  the  picture  content. 

In  addition  to  the  primary  sources  of  MTF  loss  described  in  subsequent 
paragraphs,  many  minor  deviations  from  ideality  exist  that  collectively  can 
seriously  reduce  the  system  MTF.  Some  examples  are  optical  material  scat¬ 
tering,  optical  assembly  errors  such  as  lens  tilt,  the  inability  to  focus  precisely, 
scan  speed  variations  in  fixed-time-base  systems,  scan  position  measurement 
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errors  in  variable-time-based  systems,  scan-to-scan  misregistration,  internal 
structural  vibration,  and  lossy  video  transmission  lines. 

1.4. 2.1  Equivalent  Bandwidth.  Several  investigators  have  found  that  the 
integral  of  the  squared  MTF  correlates  well  with  subjective  measures  of  image 
quality.  This  quantity  is  usually  referred  to  as  the  equivalent  line  number  Ne , 
after  Schade,40  and  is  defined  in  one  dimension  by 

Ne  =  \  [Hfx)]2  dfx  .  (1-89) 

Jo 

It  is  conventional  to  normalize  the  modulus  to  a  maximum  value  of  1  at  very 
low,  but  not  necessarily  zero,  video  frequency.  Line  number  Ne  is  related  by 
a  constant  to  visual  acutance,  a  common  measure  of  photographic  resolution. 
It  is  intuitively  justifiable  as  a  summary  measure  because  it  is  analogous  to 
the  noise-equivalent  bandwidth,  the  integral  of  the  product  of  the  squared 
frequency  response  with  the  noise  power  spectrum.  An  equivalent  resolution 
r  is  usefully  defined  by 

r  =  (2Ne)  ~ 1  .  (1-90) 


This  definition  is  chosen  to  make  the  r  for  a  rectangular  impulse  response  of 
width  a  equal  to  a.  Some  examples  of  equivalent  bandwidth  are: 


Circular  diffraction-limited  aperture: 

Ne 

=  0.072 Ifc 

(by  numerical  integration) 

=  0.272 \/D  , 

(1.91) 

Square  diffraction-limited  aperture: 

Ne 

=  X/(3 Do)  , 

(1.92) 

Gaussian  impulse  response: 

Ne 

=  (4ct\/tt)_1  , 

(1.93) 

Rectangular  detector  impulse  response: 

Ne 

=  (2a)-1  . 

(1.94) 

See  subsequent  sections  for  definitions  of  the  preceding  impulse  responses. 


1 .4.2.2  Central  Limit  Theorem  and  Equivalent  Gaussian.  The  central  limit 
theorem  of  statistics  as  applied  to  optics  states  that  the  product  of  a  series  of 
monotonically  decreasing  component  MTFs  will  tend  toward  a  Gaussian  shape. 
Since  there  are  usually  at  least  six  transfer  functions  in  a  system  (diffraction, 
optical  aberrations,  detector  geometry,  detector  time  constant  or  integration 
time,  signal  processing,  and  display),  and  usually  many  more,  the  system  MTF 
often  is  reasonably  well  approximated  by  a  circularly  symmetrical  Gaussian 
impulse  response 


r(x,y)  = 


x2  +  y2\ 
2a2  / 


(1.95) 


whose  MTF  in  either  direction  is 
Hf)  =  exp(-2 irVy2)  . 


(1.96) 
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The  definition  of  the  Gaussian  function  equivalent  to  a  given  near-Gaussian 
MTF  could  be  made  in  several  ways,  such  as  defining  equivalence  at  a  critical 
spatial  frequency  or  by  making  a  least-squares  fit.  The  recommended  way  is 
to  determine  the  a  that  produces  the  same  equivalent  bandwidth: 

cr  =  WiVA/^r1  =  0.142/JVC  .  (1.97) 

1 .4.2.3  Central  Ordinate  Theorem.  The  central  ordinate  theorem  of  Fourier 
transform  theory  states  that  the  area  of  a  function  f(x)  equals  the  central 
ordinate  of  its  transform  F(fx ): 

rco 

F( 0)  =  fix)  dx  ,  (1.98) 

J  —  00 

and  that  the  area  of  a  function’s  transform  equals  the  central  ordinate  of  the 
function 

m  =  f  F(fx )  dfx  .  (1.99) 

J  —  CO 


This  is  useful  for  calculating  the  peak  value  of  a  waveform  from  knowledge 
of  its  transform. 

1 .4.2.4  Electronic  Boost.  Electronically  improving  the  overall  system  MTF 
by  high-frequency  emphasis  is  called  video  boosting  or  aperture  correction.  The 
theory  is  well  grounded  in  experiment,  and  is  based  on  two  considerations. 
First,  matched  filter  theory  proves  that  the  detectability  of  a  signal  is  maxi¬ 
mized  by  first  whitening  the  noise  power  spectrum  prior  to  application  of  the 
matched  filter.  Second,  it  is  well  known  from  television  experiments  that  the 
parameter  of  noise  that  is  significant  is  not  the  rms  noise,  but  the  amplitude 
of  the  noise  PSD. 

It  is  demonstrable  that  a  less-than-white  PSD  can  be  whitened  with  no 
deleterious  effect.  Therefore,  in  theory,  the  signal  response  can  safely  be  boosted 
by  at  least  as  much  boost  as  will  whiten  the  noise;  in  practice,  it  is  common 
to  boost  just  enough  so  that  the  noise  does  not  "ring  ”  Kusaka41  showed  that 
a  flat  to  slightly  peaked  overall  MTF  is  aesthetically  pleasing. 

1.4.3.  Optical  OTFs 

There  are  two  limiting  cases  for  which  closed-form  expressions  are  available. 
The  first  is  the  case  of  diffraction-limited  optics  with  no  geometrical  aberra¬ 
tions.  Then  the  OTF  is  the  scaled  autocorrelation  of  the  shape  of  the  entrance 
pupil.  The  second  is  the  case  where  the  geometrical  aberrations  are  so  strong 
that  their  effect  is  describable  by  ray-trace  statistics,  as  opposed  to  wave-front 
variation  calculations.  Then  if  the  aberrations  are  not  too  severe,  they  can  be 
collectively  reasonably  approximated  by  a  Gaussian  MTF  using  Eq.  (1.96).  In 
between  is  the  general  case  where  wave-front  calculations  including  diffraction 
must  be  used,  wherein  there  are  few  closed  solutions. 

For  a  clear  circular  diffraction-limited  aperture  monochromatically 
illuminated, 
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(1.100) 


where  fc  =  D„/k. 

The  MTF  of  an  incoherent  polychromatic  optic  is  the  normalized  weighted 
integral  of  the  OTFs  at  each  component  wavelength,  given  by  Levi42  as 


MTF 


r 


MTF(/»FWX)m) 


d\ 


L 


2?\to(\)0U\)  d\ 


(1.101) 


where,  as  before,  E\  is  the  irradiance  of  the  source,  t0(\)  is  the  optical  trans¬ 
mission,  and  9fc(\)  is  the  detector  responsivity. 

Gafni  et  al.43  indicate  that  in  the  infrared  the  polychromatic  equation  often 
may  be  adequately  approximated  by  the  monochromatic  equation,  using  the 
midband  wavelength,  for  spatial  frequencies  well  below  the  cutoff. 


1.4.4  Detector  OTFs 


The  most  common  detector  spatial  geometry  is  rectangular.  If  the  detector 
dissects  the  scene  by  some  form  of  motion  such  as  scanning  or  dithering,  its 
impulse  response  in  one  direction  is: 


r(x)  =  rect|  -  )  = 
or 


1,  for  |jc/a|  ^  - 

0,  for  |*/a|  >  i 


and  its  MTF  is 

sin(TTa/*)  A 


Hfx)  = 


TTCifx 


=  sinc(a^c)  . 


(1.102) 


(1.103) 


If  the  detector  dissects  the  scene  by  staring,  the  detector  shape  influences  the 
frequency  content  of  the  image,  but  the  MTF  is  undefined  because  the  sta- 
tionarity  existence  condition  is  violated. 


1.4.5  Signal  Processing  OTFs 

The  conversion  in  a  scanning  sensor  from  spatial  frequency  fx  to  electrical 
frequency  ft  is  given  by: 


ft  =  /s0  , 


(1.104) 


where  0  is  the  scan  velocity  in  angular  units  per  second.  If  a  scanning  detector 
of  angular  dimension  a  is  temporally  integrated  for  a  time  U,  that  integration 


FUNDAMENTALS  OF  ELECTRO-OPTICAL  IMAGING  SYSTEMS  ANALYSIS  41 


has  an  equivalent  spatial  dimension  of  a;: 

a i  =  oitihd  ,  (1.105) 

where  t d  is  the  scan  dwell  time  corresponding  to  the  angular  dimension  a.  The 
resulting  MTF  is 


Hf)  =  sinc(a if)  . 

(1.106) 

If  this  or  any  other  electrical  MTF  is  significant  in  a  bidirectionally  scanning 
design,  the  MTF  loss  from  the  associated  phase  transfer  function  must  be 
accounted  for. 

A  single-RC  low-pass  filter  has 

OTF  =  (1  +jf/fcr1  , 

(1.107) 

MTF  =  [1  +  (f/fc)2V1/2  , 

(1.108) 

PTF  =  arctan(-/7/c)  ,  fc  = 

(2iirRC) - 1  .  (1.109) 

A  single-RC  high-pass  filter  has 

OTF  =  jf/a  +  jflfc )  , 

(1.110) 

MTF  =  (flfc)[  1  +  (flfc)2r1/2  , 

(1.111) 

PTF  =  arctan (fjf)  • 

(1.112) 

According  to  Sequin  and  Thompsett,44  a  charge  transfer  device  such  as  might 
be  used  in  a  focal  plane  readout,  a  time-delay-and-integrated  (TDI)  circuit,  or 
an  analog  memory  has  an  MTF  and  a  PTF  due  to  a  nonunity  charge  transfer 
efficiency  of 


MTF  =  exp{-m(l  -  e)[l  -  cos(2tt flfs)]} 


(1.113) 


(1.114) 


where  m  is  the  number  of  gates  in  the  transfer  from  the  detector  to  the  output 
amplifier,  e  is  the  charge  transfer  efficiency  of  each  gate,  and  fs  is  the  sampling 
frequency  of  the  structure. 


1.4.6  Square-Wave  Response 

Truncated  square-wave  targets  ("bar  charts”)  are  often  used  instead  of  ex¬ 
tended  sine-wave  targets  because  of  the  difficulty  of  making  the  latter,  espe¬ 
cially  in  the  infrared.  Bar  charts  also  are  used  because  the  theory  of  target 
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recognition  relates  the  probability  of  recognition  to  the  resolvability  of  bar 
charts  having  the  same  dimension  and  signal  amplitude  as  the  target.  System 
responses  to  a  series  of  bar  charts  are  also  used  to  make  an  estimate  of  the 
MTF  when  impulse  response  measuring  equipment  is  not  available.  A  four- 
bar  target  of  bar  width  W  may  be  described  in  the  direction  of  the  modulation 
using  the  notation  of  Sec.  1.5.1: 

€(x)  =  rect^*[8(*  -W)  +  8(*  +  W)  +  b(x  -  3 W) 

+  8(*  +  3 W)]  .  (1.115) 


Fourier  transforming  and  normalizing,  its  amplitude  spectrum  is: 
6(fx)  =  sinc(W/i)|j  cos(2irfcW)  +  |  cos(6tt fxW)  j  . 


(1.116) 


The  four-bar  response  of  a  Gaussian  MTF  does  not  differ  appreciably  from  its 
infinite  square-wave  response,  so  Coltman’s  relations45  between  square-wave 
response  Hf)  and  sine-wave  response  r(f)  for  a  fundamental  frequency  f  and 
its  harmonics  nf  usually  can  be  used  with  confidence  for  a  four-bar  chart: 


HSf) 

3 


+ 


HSf) 

5 


r(lf)  H9f) 

7  +  9  +  + 


plus  other  regular  terms,  and 


r(f)  + 


HSf) 

3 


HSf)  r(7  f) 

5  +  7 


(1.117) 


Hllf)  HIS  f)  Hl5f) 

11  13  15 


(1.118) 


plus  other  irregular  terms  per  Coltman. 


1.4.7  Theoretical  Limit  to  Target  Position  Estimation 

Fried46’47  derived  the  rms  uncertainty  with  which  the  position  of  a  single  point 
source  target  may  be  measured  by  a  scanning  sensor  with  one-dimensional 
output  limited  by  additive  white  Gaussian  noise.  This  noise-limited  position 
measurement  precision  depends  on  the  nature  of  the  source,  the  transfer  func¬ 
tion  of  the  measuring  system,  and  the  noise  of  the  system.  The  result  is  simi¬ 
lar  to  that  of  radar  theory  where  the  angular  measurement  precision  is  a 
resolution-related  constant  divided  by  the  voltage  SNR. 

Fried  defined  a  "resolution  scale”  80  given  by 
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_  0 
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(1.119) 


such  that  the  angular  measurement  precision  0  is 

0_  89 
SNR  ‘ 


(1.120) 


Further,  the  measurement  of  the  separation  of  two  targets  is  the  resolution 
scale  divided  by  the  "composite  SNR”  given  by 


SNRC  =  (SNRf2  +  SNR2  V172  .  (1.121) 

The  result  is  that  position  determination  is  achievable  to  a  much  finer  accuracy 
than  the  conventionally  defined  resolution  of  the  system,  for  example,  much 
less  than  \/D0,  given  sufficient  SNR.  This  result  does  not  apply  to  the  cross¬ 
scan  direction  or  to  staring  systems  in  which  the  only  knowledge  about  the 
target  location  is  that  it  falls  within  a  detector  angular  subtense  p.  In  that 
case,  the  rms  angular  uncertainty  ere  in  one  dimension  for  one  line  or  pixel  is 


0-0 


P 

yi2  ‘ 


(1.122) 


As  an  example  of  the  application  of  Eq.  (1.119),  if  the  MTF  is  a  Gaussian  as 
defined  previously  in  Eq.  (1.96), 

80  =  ctV 2tt  .  (1.123) 

For  two  targets  having  equal  SNR  and  the  80  given  by  Eq.  (1.123),  Eq.  (1.121) 
produces  the  result 


80  =  2a  .  (1.124) 

For  a  circular  diffraction-limited  aperture  of  diameter  D0,  monochromatically 
illuminated  by  light  of  wavelength  the  numerically  integrated  value  of  Eq. 
(1.119)  is 

80  =  =  0.59 /fa  .  (1.125) 

2'TT/c 

If  the  system  is  diffraction-limited  by  a  rectangular  aperture  of  width  D0,  and 
the  illumination  is  monochromatic  with  wavelength  X,  Eq.  (1.119)  produces 
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50  =  0.5\/Do  . 


(1.126) 


The  best  possible  case  is  that  of  a  unity  MTF  out  to  a  cutoff  of  fc: 


50 


vs 

2tt/c 


0. 27 6/ fc  . 


(1.127) 


1.5  SAMPLING  AND  ALIASING 

Sampling  occurs  whenever  a  system  deviates  from  convolutionary  image  for¬ 
mation  because  its  impulse  response  is  not  spatially  or  temporally  invariant. 
This  occurs  in  space  when  image  dissection  is  performed  at  discrete  loci,  such 
as  along  scan  line  centers  or  at  fixed  array  points.  It  occurs  in  time  when  the 
image  is  sampled  at  discrete  intervals,  such  as  by  framing  or  periodic  image 
integration.  Inadequately  closely  spaced  sampling  causes  disruption  of  periodic 
patterns,  a  blocky  appearance  in  static  imagery,  and  shimmering  in  moving 
images.  Many  image  interpretation  experiments  have  shown  that  sampling 
effects  are  as  detrimental  to  visual  recognition  as  are  noise  and  blurring. 

A  common  example  of  a  spatial  sampling  effect  is  the  disruption  of  the 
pattern  of  a  sportscaster’s  plaid  coat  by  the  fixed  red-green-blue  pattern  of  a 
color  TV  camera.  An  example  from  "most  wanted”  crime  videos  is  the  unrecog- 
nizability  of  the  face  of  a  witness  whose  anonymity  is  protected  by  constructing 
his  or  her  facial  image  with  a  few  coarse  blocks  of  video.  In  these  cases  some 
of  the  higher  spatial  frequency  power  in  the  original  scene  spectrum  is  shifted 
to  both  higher  and  lower  frequency  bands  called  aliases  or  aliased  frequencies. 
A  common  temporal  frequency  example  is  the  case  of  a  rotating  wheel  sampled 
in  time  by  a  TV  camera's  framing  action.  The  wheel  appears  to  move  faster, 
slower,  or  even  backward,  depending  on  its  real  rotation  rate  relative  to  the 
frame  rate. 


1.5.1  Elemental  Structures  and  Replication 

Bracewell48  and  Goodman39  introduced  a  shorthand  notation  that  produces 
compact  equational  representations  of  complicated  sampled  imaging  processes. 
Any  sampling  process  based  on  a  fixed  one-dimensional  or  a  fixed  orthogonal 
two-dimensional  sampling  lattice  is  easily  analyzed  using  their  technique.  It 
requires  only  that  the  sampling  structure  be  composed  of  elemental  averaging 
apertures  replicated  in  the  regular  pattern  of  a  sampling  lattice.  This  notation 
avoids  a  much  more  complicated  representation  by  a  series  of  equations  with 
boundary  conditions. 

The  fundamental  element  in  this  notation  is  the  Dirac  delta  function  defined 
for  one  direction  by 


S(x)  = 


h 

.0, 


for*  =  0 

for  all  y  . 

for*  =£  0 


(1.128) 


In  this  case,  5(jc)  is  a  knife-edge  extending  infinitely  along  the  y  axis. 
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A  Dirac  delta  located  other  than  at  x  =  0  is  indicated  by  8(#  -  £)  and  exists 
at  x  -  £  for  all  y.  Periodic  imaging  structures  such  as  scanned  or  staring 
detectors  are  constructed  by  replicating  the  unit  cell  of  the  array  on  lattice 
structures,  which  are  themselves  arrays  of  delta  functions.  These  lattice  struc¬ 
tures  are  called  comb  functions. 

A  one-dimensional  array  of  Dirac  deltas  separated  by  the  dimension  d  in 
the  y  direction  is  given  by 


comb 


for  y  =  nd 
otherwise 


for  all  x  . 


(1.129) 


This  can  be  visualized  as  an  infinite  series  of  knife-edges  parallel  to  the  x  axis. 
An  infinite  array  of  points  along  the  y  axis  with  separation  d  is  given  by 


comb(  ^ )  •§(*) 
\d/ 


(1.130) 


A  two-dimensional  array  of  mathematical  points  spaced  by  c  in  the  x  direction 
and  by  d  in  the  y  direction  is  represented  by 


comb 


\  c  d 
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(1.131) 


The  very  useful  rectangular  function  is  defined  by 


rect 


for  \x/a\ 

lo, 

for  | xla\ 

for  all  y  . 


(1.132) 


This  is  used  to  represent  the  unit  cell  of  a  detector  array  by 


for  \xla\  ~  and  \y/b\  *£  i 
otherwise 


(1.133) 


where  a  and  b  are  the  detector  dimensions  in  the  x  and  y  directions,  respectively. 

This  notation  is  also  useful  for  deriving  the  spectrum  of  periodic  structures 
such  as  a  bar  chart  (see  Sec.  1.4.6),  of  a  compound  detector  structure  such  as 
a  CCD  element  centrally  obscured  by  an  opaque  contact,  of  the  impulse  re¬ 
sponse  of  a  detector  array  exhibiting  crosstalk,  and  of  the  impulse  response  of 
a  TDI  array  with  misregistration  due  to  scan  velocity  error. 


1.5.2  Sampling  Mathematics 

Any  sampled  imaging  process  is  characterized  by  three  stages.  The  first  is 
convolution  of  the  object  distribution  0(x,y)  with  the  before-sampling  impulse 
response  rbs(x,y).  The  second  is  multiplication  of  that  intermediate  image  by 
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the  sampling  lattice  L(x,y)  of  delta  functions.  Proof  that  those  two  processes 
occur  in  that  order  is  given  by  Lloyd.5  The  third  stage  is  convolution  of  the 
sampled  image  with  the  after-sampling  image  processing  and  reproduction 
impulse  response  rasGe,y).  The  spatial  domain  sampled  image  signal  equation 
is: 


Kxfy)  =  {[0(x,y)*r6s(x,y)l  x  L(x,y)}*ras(x,y)  .  (1.134) 

The  equivalent  steps  in  the  frequency  domain  are  multiplication  of  the  object 
spectrum  €(fx,fy)  by  the  before  sampling  (prefiltering)  MTF  r&s( /*,£,),  convo¬ 
lution  of  this  product  with  the  transform  of  the  sampling  lattice  L(fx,fy),  and 
multiplication  of  the  resulting  aliased  spectrum  by  the  after-sampling  repro¬ 
ducing  (postfiltering)  MTF  ras(fx,fy)-  The  frequency  domain  image  equation 
is: 


Hfx,fy)  =  Wx,fy)  X  rbs(fX,fy)WfxM  X  ras(fx,fy)  .  (1.135) 

1.5.3  Signal  Aliasing  and  Noise  Foldover 

The  sequence  of  processes  in  Eq.  (1.135)  shows  that  the  postfilter  can  pass 
aliased  signal  power  into  the  output  if  the  first  harmonic  of  the  sampling 
frequency  is  less  than  twice  the  highest  frequency  present  in  the  prefiltered 
object  spectrum.  This  occurs  because  the  aliased  sideband  spectra  will  overlap 
the  fundamental  spectrum  and  masquerade  as  components  of  the  source.  The 
requirement  of  a  sampling  frequency  twice  the  frequency  of  interest  is  called 
the  Nyquist  criterion ,  and  is  elaborated  by  the  Whittaker-Shannon  sampling 
theorem. 

Similar  equations  can  be  written  for  the  noise  component  for  the  direction 
in  which  noise  is  sampled.  In  that  case  the  signal  spectrum  is  replaced  by  the 
noise  PSD  and  the  analysis  is  done  in  power  space  rather  than  signal  space, 
with  the  corresponding  change  from  linear  addition  to  addition  in  quadrature. 
The  noise  PSD  is  likely  to  be  broader  than  the  signal  spectrum  because  more 
transfer  functions  limit  the  width  of  the  signal  spectrum.  Thus  noise  "foldover” 
is  a  more  serious  effect  in  multiplexed  systems  than  is  signal  aliasing.  Usually 
such  an  analysis  is  necessary  only  for  channel-multiplexed  imagers. 

Aliasing  of  signal  masks  perception  of  scene  detail  much  the  same  as  does 
random  noise.  Resnikoff49  offered  a  proof  based  on  the  uncertainty  principle, 
which  demonstrated  the  equivalence  between  aliasing  and  noise.  Resnikoff’s 
proposed  alternative  to  disruptive  aliasing  is  to  sample  randomly  such  that 
scene  content  which  would  be  inadequately  sampled  by  a  regular  structure  is 
converted  to  less  disruptive  uncorrelated  noise,  rather  than  to  aliases. 

Another  alternative  is  to  sample  in  a  fixed  lattice,  but  to  translate  the  lattice 
by  sub-sample-spacing  dimensions  between  frames.  If  the  frame  rate  is  such 
that  several  frames  are  created  during  the  eye  integration  time  appropriate 
to  the  viewing  conditions,  then  moving  the  sampling  lattice  in  increments 
smaller  than  the  sample  separation  will  result  in  the  perception  that  the 
imagery  is  sampled  at  a  higher  spatial  frequency,  or  even  is  unsampled.  Dann, 
Carpenter,  and  Seamer50  show  the  benefits  of  such  regular  periodic  displace¬ 
ment,  which  they  called  microscanning ,  with  2x2  and  3x3  patterns  in  a 
64  x  64  imaging  array. 
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■j[0(fx,fy)  x  r0{fx,fy)  x  sinc(afx)  sinc(pfy)] 


*  [comb(6fx)  comb(8fy)]  x  rd(fXI  fy)  =  F(fx,  1y) 


Fig.  1.4  Aliasing  in  a  staring  imager. 


In  situations  where  the  sampling  rate  cannot  be  changed,  considerable  at¬ 
tention  has  been  given  to  the  question  of  whether  one  should  deliberately 
increase  prefiltering  to  reduce  aliasing  or  simply  let  the  aliasing  occur.  The 
current  consensus  based  on  simulated  imagery  is  that  one  should  not  prefilter 
more  than  the  process  naturally  dictates.  For  example,  see  the  experiment 
reported  by  van  Meeteren  and  Mangoubi.51 


1.5.4  Staring  Array  Example 

The  image  signal  equation  for  a  staring  array  with  unit  cell  dimension  a  and 
p  on  lattice  centers  separated  by  5  and  y  is: 


I(x,y)  = 


€(x,y)*r0  {x,y  )*rect 


*rd{x,y)  ,  (1.136) 


where  r0{x,y)  is  the  optics  impulse  response  and  rd(x,y)  is  the  display  (recon¬ 
struction)  impulse  response.  The  signal  spectrum  is 


}(fx,fy)  =  {W(fxjy)  X  r0(fx,fy )  x  sinc(a/*)  sinc(p fy)] 

*[comb(5 fx)  comb(y/y)]}  x  rd(fx,fy )  .  (1.137) 

The  components  of  Eq.  (1.137)  are  shown  in  Fig.  1.4.  Note  that  there  is  cross 
aliasing  in  the  x  and  y  frequencies.  Because  the  sampling  frequencies  1/8  and 
1/y  necessarily  are  less  than  half  the  maximum  frequencies  1/a  and  1/p  of 
interest  in  the  presampled  spectrum,  i.e.,  8  ^  a  and  y  ^  p,  strong  aliasing  is 
unavoidable.  Bradley  and  Dennis52  give  examples  of  imagery  from  such  staring 
arrays  and  show  corresponding  aliasing  calculations.  The  microscanning  ap¬ 
proach  of  Dann,  Carpenter,  and  Seamer50  is  the  only  solution  to  the  problem 
of  such  aliasing  short  of  optical  prefiltering  so  strong  that  its  effect  is  worse 
than  that  of  the  aliasing  it  eliminates. 

1.5.5  Interpolative  Display  Reconstruction 

Although  the  aliased  signal  information  in  an  inadequately  sampled  image 
cannot  be  unambiguously  recovered  by  any  postsampling  processing,  the  dis¬ 
turbing  "blockiness”  or  "edginess”  of  the  aliased  power  can  be  reduced  by  image 
reconstruction  with  an  interpolator.  This  is  what  is  done  in  compact  disk 
players,  which  claim  "oversampling.”  This  is  not  really  an  increase  in  input 
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sampling  but  an  interpolation  to  increase  the  number  of  output  samples  prior 
to  reproduction. 

A  simple  illustrative  example  is  the  use  of  a  one-dimensional  linear  inter¬ 
polator  to  produce  one  new  "sample”  between  each  of  the  original  samples. 
This  is  actually  a  sine  filter  with  a  first  null  at  the  sampling  frequency,  followed 
by  convolution  with  the  original  sampling  lattice  shifted  by  one-half  sample 
separation.  The  net  effect  is  to  postfilter  the  sampled  spectrum  and  shift  the 
sidebands  out  in  frequency.  From  a  mathematical  point  of  view  information 
has  been  lost,  but  the  image  is  much  more  "viewable”  because  the  edginess 
produced  by  the  sidebands  has  been  reduced  by  pushing  the  sidebands  out 
prior  to  reconstructive  postfiltering.  In  practice,  a  two-dimensional  sampling 
process  with  unavoidable  aliasing  should  be  reconstructed  with  a  two-dimensional 
interpolator. 


1.6  VISUAL  DETECTION  OF  NOISY  SIGNALS 

Two  common  experiences  exemplify  the  theory  that  follows.  The  first  is  the 
experience  of  driving  in  heavy  fog  where  you  are  straining  to  detect  small 
features  like  lights.  Then  suddenly  you  become  aware  of  an  unlighted  vehicle 
at  the  threshold  of  your  perceptibility,  close  and  looming  large  in  your  field  of 
vision,  but  devoid  of  details.  The  ability  to  draw  that  large  object  out  of  an 
otherwise  washed-out  low-contrast  scene  is  an  example  of  visual  spatial  in¬ 
tegration.  The  second  experience  is  the  appearance  of  a  single  frame  of  video 
frozen  on  a  VCR,  which  looks  noticeably  noisier  than  the  continuous  video. 
That  difference  is  an  example  of  the  phenomenon  of  visual  temporal  integration. 

A  model  of  vision  must  account  for  these  effects  to  predict  the  visual  response 
to  the  SNR  of  processed  and  reconstructed  video.  Coltman  and  Anderson,53 
Schade,54  and  Rosell  and  Willson55  observed  that  vision  seems  to  operate  as 
if  the  threshold  of  perception  of  signal  sources  in  noisy  video  is  a  function  of 
a  hypothetical  perceived  SNR.  This  quantity  is  proportional  to  the  square  root 
of  the  ratio  of  the  displayed  target  area  At  to  the  displayed  noise  correlation 
area  Ac: 


SNR p  oc 


(1.138) 


Vision  is  presumed  to  produce  this  SNR  by  an  approximation  to  matched 
filtering  with  adaptive  selection  of  tunable  compound  spread  functions.  The 
net  effect  functions  similar  to  spatial  integration  and  explains  the  phenome¬ 
non  that  large  sources  are  more  detectable  than  smaller  sources  with  the 
same  point  SNR,  within  the  limit  of  about  12  mrad  of  diameter  discovered  by 
Bagrash,  Kerr,  and  Thomas.56 

DeVries,57  Rose,58  Coltman  and  Anderson,53  Schade,54  and  Rosell  and 
Willson55  observed  that  the  visual  detection  process  also  behaves  as  if  it  were 
integrating  in  time  with  an  integration  period  ranging  from  0.05  s  at  high 
display  luminance  to  0.25  s  at  low  luminance.  This  is  presumed,  similar  to 
spatial  integration,  to  produce  a  perceived  SNR  proportional  to  the  square  root 
of  the  product  of  the  integration  time  and  the  video  frame  rate: 
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SNRp  oc 


l/2 

SNR i  , 


(1.139) 


where  te  is  the  eye  integration  time.  Combining  both  observations,  we  model 
vision  as  if  it  detects  noisy  sources  by  thresholding  the  signal  after  a  signal 
processing  enhancement,  producing  an  effective  SNR  of 


SNRp  =  SNR i(FteAT/Ac)1/2  .  (1.140) 

The  resulting  probability  of  detection  as  it  relates  to  vision  in  electronic  dis¬ 
plays  is  given  by  Lloyd.5 

An  example  of  the  application  of  the  idea  of  SNRP  is  the  minimum  resolvable 
temperature  difference  (MRTD)  concept  of  thermal  imaging.  MRTD  is  the 
minimum  temperature  difference  between  the  bars  and  the  background  of  a 
four-bar  chart  that  permits  a  70%  probability  of  visual  recognition  of  the  correct 
orientation  of  the  bars.  The  pattern  is  presumed  to  be  recognized  when  the 
SNRp  produced  by  matched  filtering  and  temporal  integration  is  high  enough 
to  support  detection  of  the  individual  bars. 

MRTD  is  plotted  as  a  function  of  the  bar  chart  fundamental  spatial  fre¬ 
quency.  The  concept  was  introduced  by  Sendall  and  Lloyd,59  and  by  Laak- 
mann,18  as  an  amplification  of  the  recognition  by  Genoud60  that  the  television 
and  photographic  analyses  of  Schade40  are  applicable  to  thermal  imaging.  The 
theory  of  MRTD  can  be  formulated  in  a  variety  of  ways.  The  model  of  Ratches61 
and  his  associates  is  the  most  widely  used  because  it  is  the  basis  for  the  U.S. 
Army's  computer  codes  for  synthesis  and  evaluation  of  thermal  imagers.  Al¬ 
ternative  derivations  are  given  in  Refs.  5  and  7.  Gao,  Kharim,  and  Zheng62 
generalized  the  Ratches  model  to  permit  extension  of  the  MRTD  concept  to 
any  system,  even  one  that  uses  machine  recognition. 

The  model  is  widely  used  because  of  government  advocacy,  but  some  details 
are  questionable.  For  example,  Vortman  and  Bar-Lev63  found  that  a  synchro¬ 
nous  integrator  model  limited  to  an  angular  extent  of  0.5  deg  better  fits  mea¬ 
sured  data  than  the  matched  filter  used  in  Ratches.  That  is,  the  synchronous 
integrator  model  shows  asymptotic  behavior  of  the  MRTD  at  low  spatial  fre¬ 
quency,  whereas  the  accepted  model  does  not.  Examples  of  the  trade-offs  pos¬ 
sible  within  the  model  are  given  in  the  papers  of  Vortman  and  Bar-Lev.64’65 
Kennedy66  also  questioned  the  low-frequency  part  of  the  model,  and  suggested 
improvements  to  account  for  aliasing  and  fixed  pattern  noise. 


1.7  APPLICATION  TO  SYSTEM  DESIGN 

This  chapter  provides  the  tools  to  make  first-order  estimates  of  the  following: 

•  the  theoretical  limits  to  resolution  and  SNR 

•  the  frequency  response  and  noise-limited  performance  of  imaging  sensors 

•  how  SNR  and  resolution  combine  to  determine  position  location  accuracy 

•  the  strength  of  scene  clutter  relative  to  signal  sources. 

The  system  specifier  or  designer  must  recognize  what  class  of  design  problem 
confronts  him  or  her  so  that  the  fundamental  problem  of  that  class  of  design 


50  IR/EO  HANDBOOK 


can  be  identified  and  solved.  Then  the  designer  can  select  from  the  tools  sum¬ 
marized  here  to  analyze  the  problem  and  allocate  performance  requirements. 
For  example,  the  design  of  a  system  for  penetration  of  severe  atmospheric 
attenuation  must  emphasize  sensitivity.  One  designed  to  work  in  high  clutter 
must  have  higher  resolution  than  is  customary.  An  intelligence  gathering 
system  should  have  an  extremely  wide  dynamic  range,  cleverly  compressed 
for  data  extraction. 

Every  design  problem  is  characterized  by  unavoidable  limits  or  restrictions, 
such  as  the  available  spectrum  or  the  permissible  optical  aperture.  A  good 
design  grows  around  those  limits  in  such  a  way  that  the  resulting  concept  is 
the  obvious  solution.  This  is  achieved  by  systematic  trade-offs  radiating  from 
the  limitations,  and  involving  FOV,  resolution,  signal  sensitivity,  target  pe¬ 
culiarities,  technology  availability,  cost,  and  risk. 

The  designer  must  avoid  "blind  spots”  in  the  technologies  used,  which  might 
allow  opponents  to  choose  to  operate  in  conditions  that  conceal  their  presence. 
This  means  that  elements  such  as  rain,  clutter,  signature  inversions,  and 
diurnal  changes  must  be  considered.  The  designer’s  own  blind  spots  are  an 
issue  as  well.  Examples  abound  of  what  the  social  critic  Lewis  Mumford  called 
"technological  exhibitionism,”  wherein  a  pet  concept  is  implemented  at  tre¬ 
mendous  expense  in  a  regime  where  it  is  clearly  suboptimal. 

Every  design  problem  is  sufficiently  unique  such  that  analyses  in  the  lit¬ 
erature  or  standard  tools  are  rarely  wholly  adequate.  A  custom  analysis  based 
on  a  tailored  theory  is  almost  always  required  because  of  peculiarities  in 
targets,  backgrounds,  and  environments.  The  original  sources  listed  here  as 
references  should  therefore  be  consulted  to  provide  the  insight  and  raw  ma¬ 
terial  for  model  development. 
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2.1  INTRODUCTION 

Accurate  predictions  of  electro-optical  (EO)  imager  performance  are  important 
for  several  reasons.  The  predictions  serve  as  a  guide  for  system  development 
by  providing  a  means  for  comparing  systems  in  their  design  phase,  and  they 
can  be  used  to  decide  if  systems  with  a  specific  design  will  meet  established 
requirements.  The  predictions  are  also  used  in  war  game  simulations  that 
directly  influence  engagement  tactics.  In  this  way,  performance  predictions 
play  a  large  role  in  the  establishment  of  future  weapons  system  requirements. 

A  complete  military  mission  can  encompass  reconnaissance,  surveillance, 
navigation,  driving  or  pilotage,  as  well  as  attacking  the  target  and  subsequent 
damage  assessment.  Ultimately,  any  prediction  of  weapon  system  performance 
should  account  for  the  whole  mission.  While  efforts  are  made  to  model  complete 
missions  in  large  war  game  models,  the  portion  of  the  mission  to  be  focused 
on  in  this  chapter  is  simply  the  location  of  targets  on  an  EO  system  display 
and  their  further  discrimination  after  location. 

The  prediction  of  military  target  acquisition  using  real-time  EO  imaging 
systems,  either  thermal,  image  intensifier  (/2),  or  television  (TV),  will  be  de¬ 
scribed.  Target  acquisition  is  taken  here  to  encompass  the  tasks  of  target 
location  and  discrimination  to  the  desired  level,  from  detection,  through  clas¬ 
sification,  recognition,  and  identification.  Most  of  the  following  discussion  will 
focus  on  predicting  the  performance  of  forward-looking  infrared  systems  (FLIRs). 
Although  many  of  the  component  descriptions  and  system  level  figures  of  merit 
to  be  discussed  are  specialized  to  the  infrared,  the  modeling  methods  described 
are  general  and  can  be  applied  to  most  real-time  EO  imagers  with  only  minor 
modification. 

The  target  acquisition  process  has  often  been  broken  conceptually  into  two 
distinct  parts,  search  and  static  performance.  In  search  tasks  (often  referred 
to  as  dynamic  or  time-dependent  tasks)  the  position  of  the  target  is  not  known 
and  time  to  locate  the  target  is  of  fundamental  importance.  Static  performance 
tasks  (or  time-independent  tasks)  are  those  where  the  position  of  the  target 
is  approximately  known  and  time  to  perform  the  task  is  not  as  important.  It 
is  usually  assumed  that  the  observer  has  as  much  time  as  desired  to  perform 
the  tasks.  Examples  of  static  performance  tasks  are  detection,  recognition,  and 
identification.  Models  of  both  types  of  processes  are  discussed.  The  static  and 
search  performance  prediction  methodologies  that  will  be  described  here  in 
most  depth  originated  at  the  U.S.  Army  Night  Vision  Laboratory.  The  basic 
methodology  developed  at  this  laboratory  serves  as  the  basis  for  most  perfor¬ 
mance  models  in  the  United  States  and  several  other  countries. 

Target  acquisition  is  complex.  Many  models  of  the  process  have  been  de¬ 
veloped,  and  often  they  are  specialized  to  only  a  few  military  scenarios.  For 
most  models  only  partial  validation  exists  due  to  the  difficulties  in  carrying 
out  realistic  field  tests.  EO  system  technology  is  rapidly  progressing  and  model 
modifications  and  updates  are  necessary  in  order  for  the  predictions  to  reflect 
accurately  the  performance  of  modern  systems.  Consequently,  the  current  pre¬ 
diction  methods  are  bound  to  evolve  and  improve.  The  reader  interested  in 
further  detail  or  historical  perspective  on  modeling  EO  system  performance  is 
referred  to  Rosell  and  Harvey,1  Lloyd,2  Ratches  et  al.,3  Biberman,4  Overing- 
ton,5  Greening,6  Schumaker,  Wood,  and  Thacker,7  and  Jones  et  al.8 

The  units  of  quantities  listed  in  Table  2.1  are  those  commonly  found  in  the 
literature  rather  than  SI  units. 
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Table  2.1  Symbols,  Nomenclature,  and  Units 


Symbol 

Nomenclature 

Units 

Detector  area 

cm2 

At 

Isothermal  area  of  target  or  background 

m2 

At 

Total  target  area 

m2 

b 

Optics  Gaussian  blur  spot  parameter 

mrad2 

c 

Speed  of  light 

cm  s"1 

D 

Optics  entrance  pupil  diameter 

cm 

D* 

Spectral  D-star 

cmHz'^W"1 

D** 

Spectral  D-double  star 

cm  Hz1'2  W  1 

E 

Exponent  in  TTPF  equation 

— 

u 

Spatial  frequency 

cycles  mrad-1 

fo 

Measuring  frequency  of  S(f ),  customarily  VrrD 

cycles  s-1 

3-dB  point  of  detector  response 

cycles  s-1 

fc 

Cutoff  frequency  of  digital  filter 

cycles  s-1 

fN 

Nyquist  frequency 

frequency  units 

/max 

Frequency  of  maximum  electronic  boost 

cycles  s-1 

fan 

Cut-on  frequency  of  preamplifier 

cycles  s-1 

/off 

Cutoff  frequency  of  postamplifier 

cycles  s-1 

U 

Sample  frequency 

frequency  units 

ft 

Temporal  frequency 

cycles  s_1 

Fr 

Frame  rate  of  sensor 

frames  s-1 

h 

Planck’s  constant 

Ws'2 

Ht&rg 

Target  height 

m 

k 

Boltzmann’s  constant 

JK1 

K 

Boost  amplitude  at  fmax 

— 

L 

Radiance 

W  cm-2  sr-1 

Eh&r 

Angular  subtense  of  bar  length 

mrad 

■i'targ 

Target  length 

m 

M 

System  magnification 

— 

n 

Number  of  device  FOVs  in  a  system  FOR 

— 

N 

Number  of  resolvable  cycles  across  a  target  dimension 

— 

n50 

Number  of  cycles  required  for  50%  probability  of  performing 
a  static  discrimination  task 

_ 

(N5o)d 

Number  of  cycles  required  for  50%  probability  of  performing 
search  detection 

_ 

rip 

Number  of  detectors  in  parallel 

— 

Ns 

Number  of  detectors  in  series 

— 

Pd 

Probability  of  detection 

— 

Po 

Single  glimpse  probability  of  search  detection 

— 

P~ 

Probability  of  finding  target  given  sufficient  time 

— 

Qb 

Background  photon  density 

photons  s-1  cm-2 

SNR  T 

Threshold  signal-to-noise  ratio  required  for  detection  of  a  bar 

— 
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Table  2.1  (continued) 


Symbol 

Nomenclature 

Units 

S(f) 

Normalized  noise  power  spectrum 

— 

t 

Time 

s 

^avg 

Average  temperature 

K 

^back 

Background  temperature 

K 

tE 

Integration  time  of  the  eye 

s 

tf 

Mean  fixation  time  of  the  eye 

s 

Ti 

Temperature  of  isothermal  area  of  target  or  background 

K 

^targ 

Mean  temperature  of  whole  target 

K 

V 

Scan  velocity 

mrad  s-1 

W 

Angular  subtense  of  Gaussian  spot  (width  at  1/e  point) 

mrad 

X 

Physical  spacing  of  image  samples 

m 

Greek: 

a 

System  horizontal  field  of  view  (FOV) 

mrad 

P 

System  vertical  FOV 

mrad 

7 

Atmospheric  extinction  coefficient 

km-1 

r 

Exponent  in  eye  modulation  transfer  function 

mrad 

A  fn 

Electronic  noise  bandwidth 

cycles  s_1 

AX 

Spectral  band 

pm 

AT 

Temperature  difference  1 

°C 

Ax 

Detector  instantaneous  field  of  view  (IFOV)  in  azimuth 

mrad 

Ay 

Detector  IFOV  in  elevation 

mrad 

A^sample 

Angular  subtense  of  a  single  sample  along  the  x  direction 

mrad 

A^sample 

Angular  subtense  of  a  single  sample  along  the  y  direction 

mrad 

8 

Charge  transfer  efficiency 

— 

T)cs 

Cold-shield  efficiency 

— 

T|ovsc 

Overscan  ratio 

— 

Quantum  efficiency 

— 

Tlscan 

Scan  efficiency 

— 

X 

Wavelength  of  light 

jim 

Vo 

Cutoff  wavelength  of  detector 

|xm 

Xjvf 

Mean  wavelength  of  EO  system  spectral  passband 

pm 

TT 

3.14159... 

— 

) 

Standard  deviation  of  subscripted  variable 

(subscripted 
variable  units) 

<r?  , 

Variance  of  subscripted  variable 

(a  units)2 

T 

Mean  acquisition  time 

s 

T A 

Atmospheric  transmission 

— 

T D 

Dwell  time  for  scanning  detector 

s 

TFOV 

Mean  acquisition  time  for  FOV  search 

s 

tfor 

Mean  acquisition  time  for  field  of  regard  (FOR)  search 

s 

To 

Optics  transmission 

— 
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Fig.  2.1  The  elements  of  target  acquisition. 


2.2  THE  ELEMENTS  OF  TARGET  ACQUISITION 

2.2.1  General  Description 

A  simplified  diagram  illustrating  the  important  components  of  target  acqui¬ 
sition  is  presented  in  Fig.  2.1.  The  radiance  from  the  scene  is  a  complex  function 
of  target  and  background  material  properties,  heat  sources,  and  atmospheric 
conditions.  The  emitted  or  reflected  radiation  traveling  toward  the  imager 
passes  through  the  atmosphere  where  some  of  the  radiance  is  absorbed  or 
scattered.  Background  radiation  can  also  be  scattered  into  the  same  path  to¬ 
ward  the  imager.  Turbulence  along  the  path  can  cause  a  difference  in  the 
amount  of  refraction  of  adjacent  rays  causing  distortions  in  the  image  formed 
by  the  imager. 

Optical  elements  gather  the  radiation,  forming  an  image  of  the  scene  at  the 
image  plane  of  the  system.  A  single  detector  or  array  of  detectors  transduces 
the  incident  radiation  into  electrical  signals,  which  are  processed  and  for¬ 
matted  for  display.  The  image  can  be  sampled  in  various  ways:  A  single  detector 
or  an  array  of  detectors  can  rapidly  scan  across  an  image,  or  a  two-dimensional 
array  can  simply  stare  at  the  scene.  A  human  views  the  image  and  tries  to 
make  a  decision  as  to  the  existence,  location,  and  identity  of  a  target.  A  model 
of  target  acquisition  requires  descriptions  of  all  parts  of  the  imaging  chain  as 
well  as  the  decision  process. 

2.2.2  Complexities  of  Target  Acquisition 

Table  2.2  lists  several  factors  and  subfactors  pertinent  to  target  acquisition. 
Although  the  list  is  by  no  means  complete,  its  length  underscores  the  com¬ 
plexity  of  target  acquisition.  No  single  model  of  the  target  acquisition  process 
could  possibly  account  for  all  of  the  factors  listed;  because  of  this,  many  models 
are  specialized  to  a  particular  handful  of  scenarios  and  system  types.  Fre¬ 
quently  they  incorporate  simplifying  assumptions,  and  they  are  usually  val¬ 
idated  for  only  a  small  portion  of  the  possible  missions  or  situations.  Using  a 
model  to  predict  performance  for  scenarios  where  the  model  is  not  validated 
or  specialized  can  lead  to  very  inaccurate  predictions. 

2.2.3  Target  Acquisition  Vocabulary 

The  three  most  commonly  used  and  confused  terms  employed  to  describe  the 
visual  problems  of  targeting  are  detection,  recognition,  and  identification.9 

As  Bliss9  implies  in  the  preceding  comment,  no  universally  accepted  set  of 
definitions  of  target  acquisition  terminology  exists  in  the  literature.  Although 
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Table  2.2  Factors  and  Subfactors  Influencing  Target  Acquisition  Performance 


Major  factor 

Subfactors 

Mission-related  factors 

Reconnaissance 

Attack  targets  of  opportunity 

Surveillance 

Attack  prebriefed  targets 

Navigation 

Vectored  attack 

Damage  assessment 

Target  and  background 

Type 

Motion 

Size 

Shadow 

Shape 

Masking 

Contrast 

Camouflage 

Temperature 

Clutter 

Reflectance 

Cues 

Emittance 

Distinctiveness 

Environment 

Visibility 

Illumination  level 

Cloud  cover 

Attenuation 

Sun  angle 

Transmittance 

Solar  loading 

Scattering 

Diurnal  variation 

Path  radiance 

Seasonal  variation 

Turbulence 

Platform 

Crew  size  and  interaction 

Altitude 

Vibration  environment 

Range 

Target  exposure  time 

Speed 

Sensor  parameters 

Sensor  type 

Sample  spacing 

Spectral  band 

Interlace 

Field  of  view 

Frame  rate 

Resolution 

LOS  panning  capability 

Dynamic  range 

Field  of  regard 

Sensitivity 

Search  field  size 

System  display 

Screen  angular  subtense 

Gamma 

Aspect  ratio 

Interlace 

Color 

Contrast  ratio 

SNR 

Veiling  glare 

Resolution 

Surround  lighting 

Phosphor  persistence 

Flicker 

Gray-scale  rendition 

Frame  rate 

Observer  variables 

Training 

Visual  acuity 

Motivation 

Search  pattern 

Experience 

Fatigue 

Prebriefing 

Age 

Stress 

Task  load 

IQ 

dictionaries  of  military  terms  have  been  compiled,10  their  definitions  are  often 
inappropriate  for  the  discussion  of  target  acquisition  prediction.  The  literature 
of  target  acquisition  is  often  misleading  or  inconsistent  due  to  the  lack  of  a 
standard  vocabulary.  A  glossary  of  search  and  target  acquisition  nomenclature 
has  been  developed11  in  an  effort  to  remedy  this  situation.  The  definitions 
presented  in  the  glossary  are  the  most  appropriate  for  description  of  target 
acquisition  tasks,  and  they  will  be  used  throughout  this  chapter. 
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Following  the  glossary,11  definitions  of  some  key  terms  that  apply  to  the 
target  acquisition  process  will  be  presented.  A  distinction  that  is  accentuated 
in  the  glossary  is  the  difference  between  static  and  search  performance  tasks. 

Some  important  time-dependent  acquisition  definitions  from  Ref.  11  follow. 

•  Target  acquisition:  All  those  processes  required  to  locate  a  target  image 
whose  position  is  uncertain  and  to  discriminate  it  to  the  desired  level 
(detection,  classification,  recognition,  identification).  The  target  acqui¬ 
sition  process  includes  the  search  process  at  the  end  of  which  the  target 
is  located  and  the  discrimination  process  at  the  end  of  which  the  target 
is  acquired. 

•  Search :  The  process  of  visually  sampling  the  search  field  using  either 
a  device  display  or  the  unaided  eye  in  an  effort  to  locate  or  acquire 
targets. 

•  Display  search:  The  search  process  limited  to  one  display  field.  This  is 
also  called  FOV  search. 

•  Localize:  To  establish  the  position  of  the  target  image  through  the 
search  process. 

Important  static  target  acquisition  task  definitions,  also  from  Ref.  11,  follow 
and  examples  are  given: 

•  Discrimination:  A  process  in  which  an  object  is  assigned  to  a  subset  of 
a  larger  set  of  objects  based  on  the  amount  of  detail  perceived  by  the 
observer. 

For  example,  discrimination  at  the  recognition  level  for  an  army  application 
would  correspond  to  the  assignment  of  an  object  to  a  subset  of  objects  that 
contains  either  tanks,  trucks,  jeeps,  or  armored  personnel  carriers. 

•  Detection:  A  temporally  unconstrained  perception  of  an  object  image  or 
a  target  image  at  a  specific  display  field  location. 

•  Pure  detection:  Detection  where  the  two  alternative  choices  are  (1)  that 
something  is  present  or  (2)  that  nothing  is  present. 

An  example  of  pure  detection  would  be  the  perception  of  a  helicopter  against 
a  bland  sky  or  a  hot  tank  against  an  uncluttered  background.  Pure  detection 
plays  a  role  in  cluttered  environments  as  well  since  it  describes  the  observer’s 
ability  to  state  whether  an  object  is  present  or  not. 

•  Discrimination  detection:  A  detection  where  the  two  alternative  choices 
are  (1)  the  object  is  a  target  or  (2)  the  object  is  something  else,  such  as 
a  natural  scene  element. 

The  scenario  to  which  one  refers  when  performing  discrimination  detection  is 
one  where  some  shape  or  form  needs  to  be  discerned  in  order  for  military 
objects  to  be  distinguished  from  clutter  objects  in  the  background.  Simply 
seeing  a  blob  in  a  cluttered  image  does  not  usually  indicate  the  presence  of  a 
target  with  a  high  degree  of  confidence.  For  performance  of  discrimination 
detection,  the  blob  in  question  must  be  compared  with  other  blobs,  and  features 
of  the  blob  must  set  it  apart  from  the  others  indicating  the  need  for  a  resolving 
capability  for  this  type  of  detection. 


EO  SYSTEM  PERFORMANCE  PREDICTION  63 


Another  type  of  detection  commonly  discussed  in  the  literature  is  military 
detection.  It  is  the  determination  that  an  object  in  an  image  is  of  military 
interest.  If  the  simple  determination  that  an  object  is  present  is  enough  to 
indicate  the  object  is  of  military  interest,  for  example,  seeing  a  point  object  in 
the  sky,  then  pure  detection  is  equivalent  to  military  detection.  If,  on  the  other 
hand,  the  observer  has  to  discriminate  between  a  particular  object  and  other 
objects  in  the  FOV  in  order  to  determine  which  is  of  military  interest,  then 
discrimination  detection  is  equivalent  to  military  detection. 

•  Orientation ,  classification,  recognition :  Intermediate  levels  of  discrim¬ 
ination  used  variously  in  the  services. 

Classification  for  army  scenarios  has  sometimes  been  chosen  to  mean  the 
discrimination  between  wheeled  and  tracked  vehicles.  Discrimination  tasks 
will  vary  in  difficulty  depending  on  how  the  target  subsets  are  defined,  i.e., 
how  many  targets  are  in  each  subset,  and  how  similar  the  target  appears  to 
other  targets  within  the  same  subset,  as  well  as  to  targets  in  different  subsets. 

•  Identification:  The  most  detailed  level  of  discrimination  generally  used 
to  describe  the  acquisition  of  military  targets. 

For  example,  a  target  is  perceived  to  be  a  particular  type  of  tank,  an  Ml 
or  a  T72. 


2.3  THE  IMAGING  CHAIN 
2.3.1  Target  and  Background 

The  spatial  and  spectral  distributions  of  radiance  from  a  scene  are  complicated 
functions  involving  the  reflective,  absorptive,  and  emissive  properties  of  the 
target  and  background.  For  imagers  operating  in  the  visible  spectrum,  a  scene 
element’s  emissive  properties  usually  do  not  play  a  role,  and  the  radiance 
distribution  is  determined  through  knowledge  of  properties  of  illuminating 
sources  such  as  the  sun  or  moon  and  the  reflective  properties  of  scene  objects. 
In  the  far  infrared  the  contribution  of  reflected  radiation  is  negligible,  and 
only  the  emissive  properties  of  targets  and  backgrounds  are  important.  In  the 
near  and  mid  infrared  both  the  reflective  and  emissive  properties  of  the  targets 
and  backgrounds  can  be  significant. 

An  EO  imager  responds  to  spatial  distributions  of  radiance  or  "signatures” 
from  targets  and  backgrounds.  This  signature  is  a  function  that  specifies  the 
radiance  from  every  point  in  the  scene  projected  onto  a  plane  or  image  per¬ 
pendicular  to  the  system  line  of  sight  (LOS).  While  the  variation  from  point 
to  point  in  a  signature  can  be  due  to  many  things  besides  temperature  vari¬ 
ation,  it  is  convenient  to  simplify  the  situation  and  assume  that  all  signal 
variations  are  due  to  differences  in  the  temperatures  of  blackbody  sources. 
Signatures  can  then  be  specified  using  radiation  temperature,  which  is  the 
temperature  of  a  blackbody  that  gives  the  same  total  radiance  in  the  particular 
waveband  of  interest  as  the  scene  element. 

It  is  common  practice  to  specify  a  temperature  difference  between  target 
and  background  for  use  in  a  performance  prediction  model.  Since  a  AT  of,  for 
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example,  5°C  will  correspond  to  different  amounts  of  power  depending  on  the 
actual  target  and  background  temperatures,  it  is  important,  for  consistency, 
to  reference  the  AT  to  a  particular  temperature,  Tref,  chosen  in  practice7  to  be 
300  K.  If  this  is  done  properly,  each  degree  of  temperature  difference  will 
correspond  to  the  same  power  difference  for  a  particular  imager  operating  in 
a  specific  spectral  band. 

Referenced  temperature  differences  can  be  calculated  from  the  power  dif¬ 
ference,  or  from  the  difference  between  radiometric  temperatures,  using 


AT 


A  L 


(2.1) 


where 


L 


Lx  d\  ,  the  blackbody  radiance  , 

A\ 


A\  =  the  spectral  band  of  the  imager  , 


the  derivative  with  respect  to  temperature  of  the  total 
blackbody  radiance  evaluated  at  the  reference  temperature 


of  300 K. 


In  the  infrared,  several  factors  can  influence  the  target  signature.  The  at¬ 
mospheric  conditions,  past  history  (running  engine  or  not),  solar  loading,  cam¬ 
ouflage,  and  the  local  background  will  all  influence  the  target  signature,  re¬ 
sulting  in  a  thermal  signature  that  is  highly  variable. 

Two  different  types  of  signatures  are  normally  discussed  in  the  context  of 
imaging:  An  inherent  signature  is  a  signature  that  has  not  been  affected  by 
the  atmosphere,  and  an  apparent  signature  refers  to  a  signature  at  the  imager 
after  having  passed  through  the  atmosphere. 

Modeling  the  Target  and  Background.  The  description  of  the  target  and 
background  in  most  target  acquisition  models  is  extremely  simple.  Two  pa¬ 
rameters  have  normally  been  used  to  describe  the  target:  its  size,  expressed 
in  terms  of  a  critical  dimension ,  and  its  contrast  with  respect  to  background. 
The  focus  here  will  be  the  infrared  in  which  the  contrast  takes  the  form  of  a 
temperature  difference. 

In  the  particular  prediction  methodology  discussed  here  in  most  detail,  and 
in  most  other  methodologies,  the  target  shape  is  taken  to  be  a  rectangle,  not 
an  object  with  a  complex  shape.  Often  the  critical  dimension  is  taken  to  be 
the  minimum  dimension  of  the  projected  target,  which  usually  turns  out  to  be 
the  target  height  ITtarg  for  ground-based  tactical  vehicles.  The  larger  dimension 
of  the  rectangle  Ltarg  is  chosen  so  that  the  rectangle  has  an  area,  At  =  #targ 
X  Ltarg,  equal  to  the  total  projected  area  of  the  actual  target.  Other  models 
use  A^2  as  the  critical  dimension. 

In  many  models  the  target  is  assumed  to  have  a  uniform  temperature,  an 
approximation  that  will  apply  well  to  some  real  targets  without  internal  struc- 
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ture  and  not  as  well  to  targets  with  a  lot  of  visible  internal  detail.  A  target’s 
internal  structure  may  not  be  visible  at  the  long  ranges  considered  when 
discussing  pure  detection,  but  for  shorter  ranges  and  higher  order  discrimi¬ 
nation  tasks,  the  influence  of  internal  "cues”  on  discrimination  performance 
can  be  significant. 

In  the  infrared,  the  inherent  target  signature  is  divided  into  i  subareas  At 
of  equal  temperature  Tj,  and  the  target’s  area  weighted  average  temperature 
is  calculated  using 


lAiTt 

^targ  =  •  (2.2) 


The  area  weighted  average  temperature  of  a  region  of  background  directly 
adjacent  to  the  target  is  calculated  similarly.  For  targets  where  the  temper¬ 
ature  differences  between  each  target  subarea  and  the  average  background 
are  all  positive,  it  is  appropriate  to  apply  the  formula  for  A T  given  in  Ref.  3: 

AT  =  Ttarg  —  Tback  •  (2.3) 

This  procedure  runs  into  trouble  sometimes  for  targets  with  prominent  hot 
spots.  Many  tactical  targets  have  been  found  to  have  some  areas  that  are  hotter 
and  some  that  are  colder  than  the  average  background  temperature.  Appli¬ 
cation  of  Eqs.  (2.2)  and  (2.3)  leads  to  the  possibility  of  targets  having  a  total 
inherent  temperature  difference  of  zero  even  though  portions  of  the  target 
have  high  and  low  temperatures.  Application  of  the  performance  prediction 
methodology  to  be  discussed  could  then  result  in  very  low  or  even  zero  prob¬ 
ability  of  detection  although  some  parts  of  the  target  were  very  bright. 

Characterization  of  the  detail  within  a  target  is  normally  not  used  in  ac¬ 
quisition  prediction,  although  it  may,  sometimes,  be  that  detail  which  is  used 
by  an  observer  to  perform  discrimination.  Several  variations  to  the  AT  defi¬ 
nition  described  earlier  have  been  proposed;  however,  none  has  been  shown  to 
improve  the  accuracy  of  performance  prediction.  The  investigation  of  target 
descriptions  that  can  accurately  account  for  the  presence  of  hot  spots  on  the 
target  continues  to  be  an  active  area  of  research. 

2.3.2  Atmosphere 

Radiation  emitted  by  a  scene  is  attenuated  as  it  passes  through  the  atmosphere 
to  the  imager.  The  attenuation  is  due  to  scattering  and  absorption  by  gas 
molecules,  aerosols,  dust,  fog,  rain,  snow,  or  man-made  obscurants.  Not  all  the 
radiation  reaching  an  imager  comes  directly  from  the  scene  since  radiation 
can  be  scattered  from  a  source  outside  the  scene  into  the  FOV  of  the  imager. 
In  the  infrared  the  atmospheric  path  along  the  imager  LOS  can  also  act  as  a 
source  of  radiance  that  reaches  the  imager. 

The  random  irregularities  in  the  index  of  refraction  of  the  atmosphere,  called 
turbulence ,  that  are  caused  by  local  variations  in  the  temperature,  pressure, 
or  humidity  can  cause  distortions  in  an  image,  motion  of  the  whole  image  or 
pieces  of  the  image,  a  blurring  of  the  image,  or  temporal  fluctuations  called 
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scintillations.  Turbulence  often  exhibits  a  strong  diurnal  cycling,  and  is  dis¬ 
tinctly  influenced  by  the  presence  of  sources  of  strong  upwelling  along  a  par¬ 
ticular  atmospheric  path.  For  an  EO  imaging  device,  the  relation  between  the 
integration  time  of  each  pixel  in  the  image  and  the  temporal  extent  of  the 
local  variations  will  determine  whether  the  turbulence  manifests  itself  mainly 
as  blurring  of  a  single  image,  or  as  an  image  distortion  that  changes  from  one 
image  to  the  next  in  an  image  sequence. 

Modeling  Atmospheric  Effects.  The  absorption,  scattering,  and  path  radiance 
of  the  atmosphere  can  be  accounted  for  by  using  a  computer  program12  such 
as  LOWTRAN  7.  The  atmospheric  transmission  through  a  particular  path- 
length  is  calculated  for  the  spectral  band  of  the  imager  and  is  applied  to 
the  target  A T.  The  resulting  apparent  AT  is  then  used  in  the  prediction 
methodology. 

Although  turbulence  in  the  atmosphere  can  result  in  blurring  and  distortion 
of  the  final  image,  it  has  not  usually  been  accounted  for  in  most  tactical 
prediction  methods.  If  turbulence  is  manifested  mainly  as  a  distortion  of  the 
image,  its  influence  could  not  be  accounted  for  simply  by  using  another  mod¬ 
ulation  transfer  function  (MTF). 

2.3.3  FUR  Systems 

Figure  2.2  illustrates  the  system  architecture  for  a  typical  "first-generation” 
tactical  FLIR  system.  The  infrared  scene  is  scanned  across  a  parallel  array  of 
detectors  inside  a  cryogenic  dewar.  Signals  from  each  detector  are  fed  in  par¬ 
allel  to  visible  light-emitting  diodes  (LEDs),  the  light  from  which  is  scanned 
across  the  face  of  a  vidicon  that  produces  the  signal  for  display.  More  recent 


Fig.  2.2  Typical  "first-generation”  scanning  FLIR  system  architecture  and  associated  sig- 
nal  processing  block  diagram. 
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Fig.  2.3  Typical  "second-generation”  FLIR  system  architecture  and  associated  signal  pro¬ 
cessing  block  diagrams,  along  and  perpendicular  to  the  scan  direction. 

imagers  utilize  an  electronic  multiplexing  scheme  to  circumvent  the  optical 
multiplexing  performed  by  the  LEDs  and  vidicon. 

The  bottom  half  of  Fig.  2.2  shows  a  block  diagram  indicating  the  important 
processing  steps  of  the  imager  for  the  purpose  of  performance  modeling.  As 
has  been  the  case  until  recently,  only  system  transfer  characteristics  along 
the  direction  of  scan  are  considered. 

A  modem  "second-generation”  FLIR  system  architecture  is  depicted  in  Fig.  2.3. 
The  continuous  image  formed  by  the  optics  is  made  discrete,  or  is  sampled,  by 
the  array  of  detectors.  The  regular  array  spatially  samples  the  continuous 
image  perpendicular  to  the  scan  direction,  producing  a  parallel  set  of  spatially 
discrete  analog  signals.  This  same  spatial  sampling  perpendicular  to  scan 
exists  for  the  first-generation  systems  depicted  in  Fig.  2.2. 

For  the  scanning  system  in  Fig.  2.3,  the  process  of  integration  of  a  signal 
for  a  fixed  time  during  scanning  also  takes  a  continuous  signal  and  samples 
it,  resulting  in  a  series  of  discrete  pulses,  this  time  along  each  scan  line.  The 
signal,  which  is  now  a  discrete  analog  signal  in  two  dimensions,  is  read  off 
the  focal  plane  by  a  charge  transfer  mechanism  and  is  passed  to  an  analog- 
to-digital  (A/D)  converter  that  assigns  a  binary  value  to  (or  quantizes)  each 
analog  sample.  Digital  processing  such  as  histogram  modification  or  filtering 
can  be  applied  before  the  digital  signal  is  converted  back  to  an  analog  signal 
and  finally  displayed.  Block  diagrams  of  processing  components  both  along  the 
scan  direction  and  perpendicular  to  it  are  shown  paralleling  recent  trends  in 
FLIR  system  performance  modeling  that  attempt  to  account  for  system  transfer 
characteristics  in  both  directions. 
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Two  dimensional  (2-D)  staring  arrays  are  being  proposed  for  more  appli¬ 
cations  since  the  size  of  the  arrays  is  increasing  while  the  quality  of  the  imagery 
they  produce  is  improving.  The  lack  of  a  scanner  leads  to  simpler,  smaller, 
more  reliable,  and  more  robust  systems. 

Modeling  FUR  Systems.  System  component  transfer  functions,  which  for  lin¬ 
ear  systems  are  the  ratios  of  output  frequency  spectra  to  input  spectra,  play 
a  central  role  in  the  system  level  figures  of  merit  described  in  the  next  section. 
Therefore,  an  appreciation  of  typical  component  transfer  characteristics  is 
necessary  for  a  complete  understanding  of  system  performance  prediction.  (See 
Chapter  1  in  this  Volume,  and  Chapters  2  and  3  in  Volume  5  of  this  handbook.) 

For  the  purposes  of  performance  modeling  of  EO  systems,  several  simplifying 
assumptions  are  usually  made  about  an  imaging  system.  Naturally  the  ac¬ 
curacy  of  the  resulting  performance  predictions  relies  on  how  large  a  departure 
from  reality  is  involved  in  these  assumptions.  For  systems  where  the  departure 
is  not  large,  the  decrease  in  complexity  of  the  problem  afforded  by  the  as¬ 
sumptions  is  usually  significant. 

EO  system  components  are  assumed  to  be  linear,  or  at  least  to  be  operating 
in  a  linear  region.  The  systems  are  also  assumed  to  be  shift  invariant,  or 
isoplanatic.  [The  response  of  a  system  to  a  point  source,  the  system  point  spread 
function  (PSF)  or  impulse  response,  does  not  change  appreciably  from  point  to 
point  in  an  image.] 

The  Fourier  transform  of  the  PSF  is  the  optical  transfer  function  (OTF), 
a  function  that  describes  the  ability  of  a  system  component  to  transfer  an 
object’s  spatial  distribution  of  light  to  an  image.  The  modulus  of  the  OTF  is 
the  modulation  transfer  function  (MTF)  and  the  argument  is  the  phase  transfer 
function  (PTF): 

SF(PSF)  =  OTF (fx)  =  MTF (fx)  exp[i  •  PTF (/*)]  .  (2.4) 

The  MTF  expresses  the  amplitude  response  of  a  system  or  system  component 
to  a  sine- wave  input.  For  many  typical  system  components  that  act  as  low- 
pass  filters,  the  MTF  describes  the  attenuation  of  contrast  with  increasing 
frequency.  The  PTF  describes  the  phase  response  due  to  a  shift  or  an  asymmetry 
in  the  PSF.  If  each  component  of  a  system  is  linear  and  shift  invariant,  then 
the  amplitude  response  of  the  total  system  can  be  modeled  using  a  single  MTF 
that  is  the  product  of  the  component  MTFs. 

In  frequency  space  an  input  spectrum  is  multiplied  by  the  transfer  function 
of  a  system  yielding  an  output  spectrum.  Working  in  frequency  space  and 
multiplying  transfer  functions  is  considerably  simpler  than  working  in  direct 
space  where  the  signal  is  convolved  by  the  impulse  response  of  the  system 
resulting  in  the  output  signal.  The  use  of  linear  systems  theory  and  Fourier 
analysis  has  shaped  not  only  the  analysis  of  EO  systems,  it  has  also  influenced 
system  measurement  methodology  and  system  performance  summary  measures. 

Until  recently,  performance  prediction  for  FLIR  systems  has  involved  the 
calculation  of  the  system  transfer  function  in  a  single  dimension  only,  chosen 
to  be  the  scan  direction.  Perhaps  this  has  been  the  case  because  of  the  devel¬ 
opment  of  a  performance  prediction  methodology  based  on  the  calculation  of 
the  number  of  resolvable  cycles  across  a  single  dimension  of  a  target.  The 
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prevalence  of  the  unidimensional  approach  may  have  resulted  partially  from 
the  difficulty  of  dealing  with  the  sampling  of  an  image  in  scanning  systems 
perpendicular  to  the  scan  direction.  Recent  efforts  have  been  directed  toward 
the  utilization  of  component  descriptions  in  two  orthogonal  dimensions  in  a 
prediction  methodology.13-15 

For  the  model  discussed  here  in  the  most  detail,  we  have  assumed  that  there 
is  only  one  noise  term,  or  rather  that  one  noise  source,  usually  the  detector, 
dominates  all  others.  Although  this  may  be  the  case  in  many  systems,  keep 
in  mind  that  many  components  of  the  system  can  act  as  noise  sources,  and 
different  system  components  can  dominate  the  system  noise  power  spectrum 
in  different  frequency  bands. 

Many  component  characterizations  involve  analytical  functions  of  spatial 
or  temporal  frequency.  For  scanning  systems  the  two  are  related  by 

ft  =  vfx  ,  (2.5) 

where  v  is  the  scan  velocity  (mrad  s-1),  ft  is  temporal  frequency  (cycles  s-1), 
and  fx  is  spatial  frequency  (cycles  mrad-1)  along  the  scan  direction. 

The  following  descriptions  of  system  components  and  signal  processing  are 
specific  to  thermal  imaging  systems.  Transfer  functions  of  typical  first-generation 
FLIR  systems  are  described  first.  System  level  performance  measures  are  then 
presented,  after  which  static  performance  prediction  methods  for  typical  first- 
generation  systems  are  outlined.  Some  modern  system  components  that  are 
not  treated  by  the  first-generation  static  performance  methodology  are  then 
described  as  motivation  for  a  discussion  of  recent  efforts  to  update  the  static 
performance  modeling  procedures. 

Line  of  Sight  Jitter.  For  the  purposes  of  system  performance  modeling,  the 
influence  of  several  causes  of  image  position  uncertainty  are  lumped  together 
into  one  term.  Vibration  of  the  sensor  with  respect  to  the  scene  is  combined 
with  scanner  position  uncertainty  and  other  causes  of  image  jitter.  The  ob¬ 
server’s  temporal  integration  of  several  frames  of  imagery  randomly  displaced 
with  respect  to  one  another  has  a  blurring  effect  most  often  accounted  for  by 
a  Gaussian  of  the  form 

Hhos(fx)  =  exp[-2(TraLos/*)2]  ,  (2.6) 

where  ctlos  1S  variance  °f  f°fal  vibration  from  all  sources. 

Optics.  For  a  diffraction-limited  system  with  a  clear  circular  aperture,  the 
MTF  of  the  optics  is  given  by 

Haiti  fx)  =  | [cos"1*  -  X(1  -  *2)1/2]  ,  (2.7) 

where 

X  =  fxlfc 

fc  =  D!\m ,  the  cutoff  spatial  frequency 

\m  =  mean  optical  wavelength  of  the  system 

D  =  clear  aperture  diameter. 
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For  apertures  that  are  not  circular  or  are  partially  occluded,  the  form  of  the 
MTF  can  be  significantly  different.  For  optical  systems  that  are  not  diffraction 
limited  the  detailed  form  of  the  optical  MTF  will  depend  on  the  specific  ab¬ 
errations  present  in  the  system.  See  Goodman16  for  more  details.  The  MTF 
due  to  the  blur  is  sometimes  assumed  to  be  a  Gaussian  of  the  form 


HbiuAfx)  =  exp (-bfx)  , 

where  b  is  related  to  the  width  of  the  Gaussian  spot  by 


b  = 


A2 


(2.8) 


(2.9) 


and  w  is  equal  to  the  blur  spot  diameter  at  the  lie  point. 

Computer  implementations  of  many  performance  models  usually  allow  the 
input  of  system  component  MTFs  of  arbitrary  shape.  This  allows  inclusion  of 
a  measured  optical  system  MTF  or  an  MTF  predicted  using  a  ray  tracing 
program  often  leading  to  greater  accuracy  than  the  Gaussian  blur  assumption. 


Detector .  It  is  usually  assumed  that  the  PSF  of  the  detector  is  a  rect  function 
in  direct  space.  Then 

Hdedfx)  =  sinc(TT^Ax)  ,  (2.10) 

where  Ax  is  the  instantaneous  field  of  view  (IFOV),  or  angular  subtense,  of 
the  detector  in  the  direction  being  considered.  Depending  on  detector  fabri¬ 
cation  techniques  and  material  properties  such  as  carrier  diffusion,  the  detector 
spatial  response  can  have  more  rounded  edges  and  sloping  sides  than  a  rect 
function.  The  temporal  response  of  detectors  to  incident  radiation  is  not  in¬ 
stantaneous  and,  for  scanning  systems,  this  results  in  a  blurring  in  the  scan 
direction  given  by 


H tempi  ft)  - 


(2.11) 


where  /*  is  the  3-dB  point  of  the  detector  temporal  response. 

A  measure  of  the  detector  sensitivity  that  is  commonly  used  in  FLIR  system 
performance  calculations  is  detector  specific  detectivity,  Z)**.  For  an  ideal 
background-limited  detector  with  no  cold  shielding  exposed  to  2tt  steradians 
of  background  radiation, 

D**(\)  =  T]q (\)1/2  2^  Qb  1/2  ,  (2.12) 

where 


=  detectivity  at  \  (cm  Hz1/2  W  l) 
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r  ^ co 

Qb  =  Jo  QbUJb) 

Xco  =  cutoff  wavelength  _x 

QbO^Tb)  =  ^T(exPTT^ - 1)  =  spectral  photon  flux  density  from 

\  \  Kki  b  / 

a  background  of  temperature  7s  (photons  s-1  cm"2) 

&  =  Boltzmann’s  constant  =  1.3805  x  10_23JK_1 

h  =  Planck’s  constant  =  6.6256  x  10-34Ws-2 

c  =  speed  of  light  =  2.9979  x  1010cms_1. 

The  detectivity  of  a  cold-shielded  detector,  D*,  assuming  a  small  effective  cold- 
shield  //#,  fcs ,  is 

D*  =  2(fl#)T\c8D**  , 

where 


%s  =  /cS/(/*/#)  • 


Electronics .  The  signal  from  the  detector  is  usually  ac  coupled  in  first-generation 
FLIR  systems  in  order  to  get  rid  of  the  large  background  pedestal.  This  ac 
coupling  is  modeled  as  a  simple  RC  high-pass  filter  where 


preamp 


(ft)  = 


ft/fo 


[i  +  (ft/un 


2iV2 


(2.13) 


The  cut-on  frequency  /on  is  the  3-dB  point  of  the  preamplifier  response. 
The  postamplifier  is  modeled  as  an  RC  low-pass  filter  and  is  given  by 


postamp (  ft)  -  fl  +  (/i//ofT)2]V2  - 


(2.14) 


where  f0a  is  the  3-dB  point  of  the  postamplifier  response. 

Electronic  boost  or  aperture  correction  is  sometimes  used  to  flatten  the 
system  response  out  to  a  frequency  where  the  noise  level  becomes  appreciable 
in  relation  to  the  signal.  Boost  transfer  characteristics  are  given  by 


-ffboost  (ft)  —  1  + 


(2.15) 


where  /raax  is  the  frequency  at  which  the  boost  is  maximum  and  K  is  the  boost 
amplitude  at  fmax.  The  boost  operation  has  normally  been  applied  only  along 
the  scan  direction. 


Display.  The  display  acts  to  reconstruct  the  signal  for  the  observer.  If  we 
assume  the  display  to  be  a  CRT  with  a  Gaussian  spot  shape,  the  display  MTF 
is  given  by 
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•^display  (  fx)  ~  ®XP 


(2.16) 


where  w  is  the  width  of  the  Gaussian  spot  at  the  1/e  point.  Flat-panel  displays 
are  becoming  attractive  alternatives  to  CRT  displays  due  to  their  light  weight, 
low  power  consumption,  and  small  volume.  Most  flat-panel  display  technologies 
employ  a  regular  grid  of  rectangular  (or  square)  pixels.  Thus,  instead  of  a 
Gaussian  spot  as  for  the  CRT,  the  display  component  PSF  is  more  nearly  a 
rect  function,  resulting  in  a  sine  function  MTF. 


2.3.4  The  Observer 

The  human  visual  system,  consisting  of  the  eye  and  parts  of  the  brain,  is  the 
final  component  in  a  target  acquisition  system.  The  human  plays  the  central 
role  in  the  target  acquisition  process,  and  a  knowledge  of  the  functions  and 
capabilities  of  this  final  component  in  the  system  is  necessary  in  order  to 
appreciate  completely  the  role  of  the  observer  in  performance  prediction  meth¬ 
odologies.  A  short  discussion  will  give  an  understanding  of  the  complexity  of 
the  human  visual  system  and  the  contrasting  simplicity  with  which  the  eye 
is  usually  treated  in  performance  models.  See  Refs.  17  through  20  for  more 
complete  descriptions  of  the  anatomy  and  functions  of  the  visual  system. 

Sensitivity.2122  The  human  eye  is  able  to  respond  to  illumination  levels  that 
vary  over  10  orders  of  magnitude  due  to  a  combination  of  different  mechanisms. 
Two  different  receptor  types,  rods  and  cones,  located  in  different  portions  of 
the  retina  (see  Fig.  2.4)  respond  to  different  intensities,  contributing  to  the 
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Fig.  2.4  The  number  of  rods  and  cones  (left  axis)  and  relative  visual  acuity  (right  axis) 
versus  angle  from  the  fovea  (from  Refs.  19  and  120). 
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large  dynamic  range  of  the  eye.  The  cones,  which  are  located  mostly  within  a 
small  angle  subtending  approximately  1.5  deg  about  the  visual  axis  called  the 
fovea,  provide  color  and  detail  information.  The  fovea  is  the  area  used  to 
interrogate  an  EO  system  display,  fixate  on  a  target,  and  provide  detail  in¬ 
formation.  The  cones  function  primarily  at  high,  or  photopic,  illumination 
levels.  The  rods  respond  at  relatively  low,  or  scotopic,  illumination  levels  where 
the  cones  are  not  sensitive.  The  response  of  both  types  of  receptor  to  input 
intensity  is  roughly  proportional  to  the  logarithm  of  the  input  illumination, 
another  feature  that  contributes  to  the  eye’s  dynamic  range. 

A  relatively  small  portion  of  the  ability  of  the  visual  system  to  adapt  to 
different  intensities  and  to  remain  sensitive  over  a  wide  range  of  illumination 
levels  is  accomplished  simply  by  opening  and  closing  the  pupil.  One  main 
utility  of  the  pupil  is  its  rapid  response.  A  much  larger  part  of  the  adaptation 
is  handled  by  the  variation  of  the  receptor  response  to  different  levels  of  il¬ 
lumination.  The  rods  in  the  periphery  are  more  sensitive,  and  they  become 
saturated  with  increased  background  levels.  The  cones  in  the  fovea  do  not 
appear  to  saturate  and  they  rapidly  adapt  to  changes  in  background  level. 

Acuity.  The  ability  of  an  observer  to  discriminate  fine  detail  in  an  image, 
the  acuity,  is  influenced  by  several  factors.23  Acuity  is  usually  defined  as  the 
reciprocal  of  the  threshold  visual  angle  in  minutes  of  arc  as  measured  using 
a  standard  test  pattern.  Several  different  test  patterns  are  commonly  used, 
i.e.,  bar  patterns,  sine- wave  gratings,  and  Landolt  Cs.  Threshold  is  defined  as 
the  point  at  which  an  observer  or  ensemble  of  observers  is  just  able  to  perform 
a  task  such  as  detection.  It  is  usually  chosen  as  a  particular  point  (50%  or 
75%)  on  a  psychometric  function  (a  relation  between  stimulus  level  and  pro¬ 
portion  of  correct  responses).  As  shown  in  Fig.  2.4,  the  acuity  of  the  eye  closely 
follows  the  density  of  cones  on  the  retina,  being  greatest  at  the  fovea  and 
falling  off  rapidly  in  the  periphery.  For  this  reason,  the  luminance  level  strongly 
affects  acuity,  being  greatest  at  high  light  levels  where  the  cones  operate. 
Acuity  decreases  as  pupil  size  increases,  and  the  outer  portions  of  the  lens  of 
the  eye,  which  contain  more  aberrations,  are  used  to  form  the  image. 

The  acuity  of  the  human  visual  system  is  commonly  expressed  using  sine- 
wave  contrast  threshold  measurements  for  varying  spatial  frequencies.  Threshold 
modulation  averaged  over  a  large  group  of  test  subjects  is  plotted  in  Fig.  2.5 
as  a  function  of  spatial  frequency.24  Also  indicated  are  limits  that  include  90% 
of  the  test  population  results.  It  is  interesting  to  note  that  the  visual  system 
modulation  sensitivity  is  best  near  3  to  5  cycles  deg-1  and  requires  more 
modulation  at  lower  as  well  as  at  higher  spatial  frequencies.  The  visual  system 
is  not  able  to  spatially  integrate  signals  completely  from  the  large  (low-frequency) 
targets  as  it  is  from  intermediate  and  high  spatial  frequency  targets. 

Spatial  Summation.25  The  eye-brain  is  able  to  sum  an  input  stimulus  over 
space  and  time.  This  capability  profoundly  influences  the  observer’s  target 
acquisition  capabilities,  and  it  is  reflected  in  the  system  performance  measures 
discussed  in  the  following  section.  Spatial  summation  has  been  investigated 
by  measuring  the  threshold  detectability  of  simple  stimuli  of  varying  spatial 
and  temporal  extent. 

Figure  2.6  indicates  how  threshold  intensity  varies  with  target  area  for 
foveal  targets  presented  for  12.8  ms.  The  curve  exhibits  a  region  where  thresh- 
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Fig.  2.5  Spatial  contrast  threshold  function  for  sine-wave  targets.  Dashed  lines  indicate 
limits  for  90%  of  the  test  population.  (From  Ref.  24,  as  developed  by  S.  J.  Briggs.) 


Log  Area  (Degrees2) 


Fig.  2.6  Measurements  indicating  spatial  summation  in  the  human  visual  system.  Log 
minimum  detectable  light  intensity  versus  log  target  area  in  degrees2.  Red  target  disk  is 
presented  at  fovea  of  dark  adapted  eye  for  12.8  ms.  Filled  and  open  circles  represent  data 
from  two  observers.  (From  Ref.  22,  based  on  data  from  Ref.  121.) 


EO  SYSTEM  PERFORMANCE  PREDICTION  75 


old  intensity  varies  inversely  with  area  (slope  of  -1)  indicating  complete 
spatial  summation.  For  somewhat  larger  targets,  there  is  a  region  where  the 
slope  is  between  -1  and  0,  indicating  only  partial  summation.  For  a  large 
range  of  illumination,  therefore,  dimmer  targets  are  easier  to  see  if  they  are 
larger.  The  curve  finally  flattens  for  large  targets,  indicating  a  region  of  little 
or  no  spatial  summation. 

The  region  of  complete  spatial  summation  increases  in  size  with  increasing 
angle  from  the  fovea.  For  targets  fixated  on  the  fovea,  complete  spatial  sum¬ 
mation  occurs  only  for  small  targets  (approximately  6  or  7  min  of  arc).  Targets 
up  to  1  deg  in  diameter  are  completely  summed  when  viewed  15  deg  from 
fixation.  For  targets  fixated  nearly  40  deg  from  the  fovea,  measurements20 
have  indicated  complete  spatial  summation  of  target  diameters  as  large  as 
4.7  deg. 

Temporal  Summation.26  Experimental  evidence  indicates  that  the  eye-brain 
temporally  integrates  energy  from  the  image  for  a  period  that  depends  on  the 
intensity  of  the  target,  its  background  or  adaptation  level,  target  spatial  fre¬ 
quency,  and  a  host  of  other  factors.27  Figure  2.7  shows  an  observer’s  threshold 
detection  capability  for  single  pulse  target  disks  of  varying  duration,  spatial 
extent,  and  background  intensity.  Up  to  a  pulse  duration  called  the  critical 
duration  the  detection  threshold  varies  inversely  (sensitivity  increases)  with 
pulse  duration.  This  indicates  a  region  of  complete  temporal  summation  similar 
to  the  case  for  spatial  summation.  For  pulses  that  are  longer  than  the  critical 
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Fig.  2.7  Measurements  indicating  temporal  summation.  Log  of  the  threshold  intensity 
versus  log  of  pulse  duration  for  two  different  size  targets  at  five  different  background  levels. 
(From  Ref.  26,  based  on  data  from  Ref.  25.) 
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duration,  the  curves  begin  to  level  off,  indicating  a  region  of  incomplete  sum¬ 
mation  and,  finally,  when  the  slope  is  zero,  a  region  of  no  summation  analogous 
to  the  situation  for  spatial  summation.  For  smaller  targets,  the  region  of  com¬ 
plete  temporal  summation  extends  to  longer  durations  than  for  larger  targets. 

Modeling  the  Observer.  The  properties  of  the  human  visual  system  are  re¬ 
flected  in  many  places  in  performance  prediction;  they  are  not  simply  another 
MTF  in  the  image  processing  chain.  Spatial  and  temporal  summation  as  well 
as  assumptions  about  how  the  human  performs  detection  are  essential  facets 
of  any  static  performance  model.  Search  models  sometimes  specifically  include 
peripheral  visual  acuity  and  eye  movement  characteristics. 

In  the  prediction  methods  to  be  discussed,  the  images  of  tactical  vehicles  or 
bar  patterns  used  for  system  testing  are  assumed  to  be  completely  summed 
spatially.  In  reality,  some  targets  of  interest  can  be  large  enough  that  they 
are  incompletely  summed.  The  spatial  summation  of  signal  and  noise  is  as¬ 
sumed  to  behave  like  a  matched  filter  that  has  been  matched  to  the  image  of 
the  target  after  having  passed  through  the  imager.  Similar  models1  have  in¬ 
corporated  what  was  termed  a  synchronous  integrator  for  the  same  purpose. 

Although  the  time  interval  over  which  the  eye-brain  totally  sums  an  input 
scene  has  been  shown  to  vary  with  illumination  level,  for  the  purposes  of  target 
acquisition  predictions  using  FLIRs,28  the  eye  has  typically  been  assumed  to 
sum  for  a  single,  fixed  integration  time  ts  routinely  chosen  to  be  between  0.05 
and  0.2  s.  Since  typical  display  illumination  levels  for  FLIRs  do  not  vary  over 
several  orders  of  magnitude,  the  single  fixed  integration  time  is  an  adequate 
approximation.  For  typical  imaging  systems  that  produce  25  to  30  images  per 
second,  the  length  of  tE  indicates  that  the  human  integrates  several  frames  of 
information  from  an  EO  display. 

Based  on  earlier  work  by  de  Vries,29  Rose,30  and  Schade,31  Rosell1’32  applied 
fluctuation  theory  concepts  to  the  detectability  of  objects  in  noisy  television 
imagery.  De  Vries  postulated  that  in  order  for  an  object  to  be  detectable  the 
signal  to  noise  ratio  (SNR)  of  the  image  must  exceed  some  threshold  value. 
Rosell  and  Willson33,34  related  the  video  SNR  (SNRy)  to  a  displayed  image 
SNR  (SNR di)-  In  transforming  from  SNRy  to  SNR di  they  accounted  for  the 
spatial  and  temporal  integration  properties  of  the  human  visual  system  but 
did  not  account  for  the  eye  MTF  or  any  noise  sources  in  the  visual  system: 

SNR ,di  =  SNR^2^Arj  ^  .  (2.17) 

Here  At  is  the  target  area,  Ad  is  the  area  of  the  display,  Fr  is  the  frame  rate 
of  the  sensor,  and  tE  is  the  integration  time  of  the  eye. 

Rosell  and  Willson  performed  numerous  psychophysical  tests  using  noisy 
imagery,  the  results  of  which  demonstrated  that  the  probability  of  detection 
was  a  strong  function  of  SNR/)/.  Figure  2.8  shows  results  of  testing  the  de¬ 
tectability  of  various  size  rectangles  in  white  Gaussian  noise,  indicating  a  50% 
probability  of  detection  for  an  SNR di  of  approximately  2.8.  This  is  one  of  the 
fundamental  relations  used  in  the  pure  detection  prediction  methodology  to 
be  discussed  in  a  later  section.  A  thorough  discussion  of  the  influence  of  noise 
on  the  human  visual  system  is  found  in  Peli.35 
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Fig.  2.8  Corrected  probability  of  detection  versus  SNRd/  required  for  rectangular  images 
of  size  (O)  4  x  4,  (□)  4  x  64,  (A)  4  x  128,  and  (0)  4  x  180  scan  lines  (from  Ref.  33). 


The  human  visual  system  is  a  nonlinear  device  and  strictly  speaking  should 
not  be  described  by  an  MTF.36  Again,  an  approximation  is  made  for  modeling, 
the  objective  being  to  describe  the  human  within  the  confines  of  a  linear  system 
framework.  Many  researchers  have  commented  on  the  suitability  of  a  partic¬ 
ular  eye  model  for  performance  prediction,  the  appropriate  choice  still  being 
a  topic  of  current  debate  (see  Holst  and  Taylor37  for  an  example). 

The  MTF  of  the  visual  system  as  determined  by  Kornfeld  and  Lawson,38 
which  is  used  in  the  static  performance  model  to  be  discussed,  is  given  by 

Heye(fx)  =  eXp[-d7*)]  ,  (2.18) 

where  T  is  plotted  in  Fig.  2.9(a),  and  Fig.  2.9(b)  illustrates  the  visual  system 
MTF  for  several  light  levels. 


2.4  SYSTEM  PERFORMANCE  MEASURES 

The  description  of  system  level  figures  of  merit  for  EO  imagers  is  a  necessary 
precursor  to  a  discussion  of  their  application  in  a  performance  prediction  meth¬ 
odology.  The  discussion  that  follows  describes  FLIR  performance  measures  in 
detail.  Performance  measures  for  TVs  and  image  intensifies,  minimum  de¬ 
tectable  contrast  (MDC)  and  minimum  resolvable  contrast  (MRC),  are  similar 
as  is  their  use  in  performance  prediction.  For  derivation  and  discussion  of  those 
measures  appropriate  for  TV  sensors,  see  Leslie  et  al.39  For  detailed  discussion 
of  image  intensifier  performance  measures,  see  Lawson,40  and  Refs.  41  and 
42.  For  further  discussion  of  FLIR  performance  measures,  refer  to  Lloyd2  and 
Ratches  et  al.3 
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Fig.  2.9  (a)  T,  the  light  level  dependent  parameter  in  the  eye  MTF,  as  a  function  of  light 
level  (footlamberts).  (b)  The  eye  MTF  of  Kornfeld  and  Lawson  as  used  in  the  NVL  static 
performance  model  for  three  different  light  levels. 


2.4.1  FUR  Performance  Measures 

Noise  Equivalent  Temperature  Difference  (NET  or  NETD).  NET  is  a  conve¬ 
nient  expression  of  the  sensitivity  of  a  thermal  system.  It  is  the  temperature 
difference,  referenced  to  300  K,  between  a  large  target  (a  rectangle  or  square 
at  least  10  times  the  detector  angular  subtense)  and  its  background,  which  is 
required  to  produce  a  peak  signal  to  rms  noise  of  one  at  a  particular  point  in 
the  signal  processing  chain.  Customarily,43  the  signal  is  measured  after  the 
amplifier  of  the  FLIR  using  a  single-pole,  low-pass  filter  with  a  3-dB  point  of 
(2Trf)_1  where  the  dwell  time  t a  is  the  time  it  takes  a  point  source  to  scan 
across  a  detector  width. 

As  in  Ratches  et  al.,3  NET  is  equal  to 


NET 


(A/-n)1/24(/y#)2 

VToTAApI&f  D*d\  ’ 

•'AX  o  i 


(2.19) 


where 

Lx 

=  spectral  radiance  (W  cm-2  sr_1  (xm-1) 

fl# 

=  system  effective  //# 

To 

=  optics  transmission 

TA 

=  atmospheric  transmission  over  the  laboratory  path  used  to 

make  the  measurement 

Ad 

=  detector  area  (cm2) 

Ns 

=  number  of  detectors  in  series 

AX 

=  spectral  band  (pan) 
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dL\/dT 
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Sift) 

fo 

He lect(  ft) 

HB(ft) 

HMD(ft) 


derivative  with  respect  to  temperature  of  the  spectral 
radiance 

spectral  detectivity  (cm  Hz1/2  W-1) 
electronic  noise  bandpass 

Jroo 

'  S{ft)HlteMt)H2B(ft)H2MD(ft)  dft 

0 

normalized  noise  power  spectrum  [Sift)  =  1  at  fo] 
measuring  frequency  at  which  Sift)  is  normalized, 
customarily  chosen  as  1/(2t d)  in  hertz 
electronics  transfer  function  =  {1/[1  +  ift/fo)2]}1/2 
boost  transfer  function 

transfer  function  of  the  measuring  device  customarily 
taken  to  be  a  low-pass  filter  with  3-dB  point  at  1/(2tz>). 


NET  is  commonly  referenced  to  the  bandwidth 


**  “  fA*  =  £ 


(2.20) 


where 


npAxAyit]  scan 

TjT)  =  - 

otfi  Fjrq 

OVSC 

and 

tz)  =  detector  dwell  time,  the  time  it  takes  one  detector  element  to 
scan  a  point  in  object  space 
rip  —  number  of  detectors  in  parallel 

Ax  —  angular  subtense  of  the  detector  in  the  scan  direction  in 
milliradians 

Ay  =  angular  subtense  of  the  detector  in  the  orthoscan  direction  in 
milliradians 
T|Scan  =  scan  efficiency 

a  =  horizontal  system  field  of  view  in  milliradians 

p  =  vertical  system  field  of  view  in  milliradians 

Fr  =  frame  rate 
Tjovsc  =  overscan  ratio  =  Ay/Aysampie 


where 


Aysample  — 


Tip  X  M interlace 


and  A/interlace  is  the  number  of  fields  per  frame. 

NET  has  been  widely  used  to  specify  system  sensitivity  or  low-frequency 
response,  but  this  figure  of  merit  has  certain  drawbacks.  Since  it  does  not 
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include  display  or  observer  response  characteristics,  NET  does  not  relate  di¬ 
rectly  to  human  performance.  Kennedy44  suggests  a  "pixel”  NET  being  equal 
to  the  square  root  of  the  variance  of  a  sequence  of  samples  taken  from  a 
particular  detector.  He  also  discusses  ways  to  incorporate  nonuniformity  into 
the  measure. 

Minimum  Detectable  Temperature  Difference  (MDT  or  MDTD).  Minimum 
detectable  temperature  difference  is  a  laboratory  measure  of  thermal  system 
sensitivity,  which,  unlike  NET,  includes  the  human  operator.  It  relates  directly 
to  the  noise-limited  detection  performance  of  the  system  and  will  be  used  in 
the  detection  prediction  method  to  be  discussed  in  the  following  section. 

MDT  is  the  temperature  difference  between  a  square  (or  circular)  target 
and  a  uniform  background  when  viewed  through  a  FLIR,  which  is  required 
by  a  trained  observer  to  just  detect  the  target.  The  observer  knows  the  ap¬ 
proximate  location  of  the  target  on  the  system  display  and  is  given  as  much 
time  as  needed  to  determine  whether  he  or  she  can  detect  the  target. 

The  derivation  of  MDT  following  Ratches  et  al.3,45  assumes  that  the  eye 
sums  an  input  scene  for  a  fixed  integration  time  f#,  chosen  to  be  0.2  s.  The 
spatial  summation  capability  of  the  eye  is  modeled  using  a  matched  filter. 

Calculation  of  the  signal  used  in  the  MDT  equation  involves  convolution  of 
the  target  with  the  system  PSF.  The  resulting  degraded  image  of  the  target 
is  convolved  with  a  matched  filter  that  has  been  matched  to  the  degraded 
target.  The  signal  used  in  the  MDT  equation  is  the  peak  of  the  degraded  image 
after  filtering  with  the  matched  filter  multiplied  by  the  number  of  frames  in 
a  visual  response  time. 

The  detector  noise  power  is  filtered  by  all  system  components  after  the 
preamplifier  including  the  display  and  eye  in  order  to  arrive  at  a  perceived 
noise.  The  result  is  convolved  with  the  matched  filter,  which  again  has  been 
matched  to  the  degraded  image  of  the  target,  to  get  the  single  frame  noise 
power  spectrum  used  in  the  MDT  equation.  Integrating  the  noise  power  spec¬ 
trum  over  frequency,  we  get  the  variance  of  the  noise,  which  is  then  multiplied 
by  the  number  of  frames  in  a  visual  response  time.  The  square  root  of  this 
quantity  is  used  as  the  noise  in  the  signal-to-rms-noise  value  in  the  MDT 
equation.  The  MDT  is  taken  to  be  that  temperature  difference  between  target 
and  background  where  the  SNR  is  equal  to  a  fixed  SNR  threshold,  SNRri- 

The  equation  for  MDT  is 


MDT 


NET  SNRn  I"  Ayu  ~| 1/2 

AT[  H*THld2f^ovscFRtE^ 

J  —  oo 


rx  rx 

S ( fx)He\ect(  /*)i?display  (  fx,fy) 

J  —  coJQ 


X  H2eye(fx,fy)H2T(fx,fy)H2D(fx,fy)  dfx  dfy 


(2.21) 


where 

At 


=  target  area  (mrad2) 
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Fig.  2.10  A  typical  plot  of  MDT  showing  relative  sizes  of  the  MDT  test  pattern. 


SNRn  =  threshold  SNR  for  the  MDT  target 

Ht  =  Fourier  transform  of  the  target  (a  circle  or  square) 

Hd  =  total  device  and  eye  MTF 
Ff display  =  display  MTF 
He  ye  =  eye  MTF. 

The  threshold  value  for  SNRti  of  2.25  is  the  result  of  an  empirical  fit  of  MDT 
measurements.  MDT  is  measured  for  a  set  of  targets  of  increasing  area  and 
is  often  plotted  as  A T  versus  l/(target  area)  as  in  Fig.  2.10.  The  curve  is  not 
asymptotic  for  small  targets  since  a  target  can  be  made  detectable  by  increasing 
its  temperature  even  when  its  angular  subtense  is  smaller  than  an  IFOV. 

Minimum  Resolvable  Temperature  Difference  (MRT  or  MRTD).  Following 
work  on  television  systems  by  Schade  46  Coltman  and  Anderson  47  and  others, 
Lloyd  and  Sendall48  developed  the  thermal  imager  system  performance  mea¬ 
sure,  MRT.  It  is  of  key  importance  in  the  static  performance  prediction  method 
to  be  described  in  the  following  section.  MRT  is  a  noise-limited  threshold 
measure  of  system  spatial  resolution  and  thermal  sensitivity,  which  includes 
the  characteristics  of  the  human.  It  is  defined  as  the  temperature  difference 
between  a  uniform  background  and  the  bars  of  a  four-bar  pattern,  each  bar 
having  a  7:1  aspect  ratio  (so  the  overall  pattern  will  be  a  square),  which  is 
required  by  a  trained  observer  to  just  resolve  all  four  bars  when  viewing  the 
pattern  through  the  imager. 
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MRT  was  originally  defined  for  a  scanning  FLIR,  and  in  the  measurement 
procedure  the  bars  of  the  four-bar  pattern  are  oriented  perpendicular  to  the 
scan  direction  of  the  FLIR.  The  observer  is  allowed  to  adjust  the  gain  and  level 
settings  of  the  FLIR  as  well  as  his  or  her  position  relative  to  the  system  display 
during  the  measurement  in  order  to  minimize  the  temperature  difference  re¬ 
quired  to  just  resolve  the  target.  The  just  resolvable  temperature  differences 
are  determined  for  several  bar  patterns  of  increasing  fundamental  frequency, 
and  the  results  are  plotted  as  in  Fig.  2.11. 

The  MRT  derivation  is,  in  many  ways,  similar  to  the  MDT  derivation.  Signal 
from  a  single  bar  is  filtered  by  the  system  and  then  by  a  matched  filter,  which 
has  been  matched  to  the  degraded  image  of  the  bar.  Noise  from  an  area  of 
background  equal  to  that  of  the  bar  is  also  filtered  by  the  FLIR  and  matched 
filter.  The  temporal  response  characteristics  of  the  eye  are  accounted  for  by 
multiplying  the  signal  and  noise  variance  by  the  number  of  frames  in  a  visual 
response  time. 

Again  following  Ratches  et  al.,3  the  equation  for  MRT  is 


MRT (fx)  =  SNRr2 


-it2  NEAT  [  A yvfxQ  T/2 
4\/l4  Htotifx)  \_AfnFRtET\  ovsc  J 


(2.22) 


Fig.  2.11  A  typical  MRT  plot  indicating  the  relative  sizes  of  the  MRT  four-bar  pattern  at 
different  spatial  frequencies. 
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where 

SNRr2  =  threshold  SNR  necessary  to  resolve  the  four-bar  pattern  also 
taken  to  be  2.25 

Htot  =  total  system  MTF 

v  =  detector  scan  velocity  in  milliradians  per  second 

fx  =  target  fundamental  spatial  frequency  in  cycles  per 
milliradian 

and  the  noise  filtering  term 

Q  =  f  S(fx)H2N(fx)H2w(fx)H%e(fx)  dfx  , 

Jo 

where  Hn(  fx )  is  the  noise  filter  function  from  the  detector  to  display  and  Hw(fx) 
is  the  target  filter  function  for  a  bar  of  width  W,  and,  hence,  sinc(TrW^). 

As  can  be  seen  from  Fig.  2.11,  the  temperature  difference  required  to  resolve 
the  four  bars  increases  as  the  bars  get  smaller.  Unlike  MDT,  the  MRT  curve 
is  finally  asymptotic  at  a  spatial  frequency  near  (Ax)-1  since  even  very  large 
temperature  differences  will  not  allow  resolution  of  bar  patterns  where  one 
cycle  of  the  bar  pattern  is  smaller  than  a  detector  angular  subtense.  Because 
of  this  and  because  other  component  MTFs  limit  the  visible  contrast  at  high 
frequencies,  for  first-generation  common  module  FLIR  systems,  one  cannot 
usually  measure  a  resolvable  frequency  higher  than  approximately  0.8(Ax)-1. 

It  is  implicit  in  the  measurement  of  MRT  that  the  performance  of  the  ob¬ 
server  is  limited  by  "well-behaved”  noise  on  the  display.48  It  was  realized 
that  the  noise-limited  case  was  "significant  because  an  infrared  imaging  sys¬ 
tem  exhibits  its  ultimate  sensitivity  when  noise  is  visible  to  an  observer.  In 
a  well  designed  system,  noise  is  visible  only  with  high  system  gain,  as  is  used 
under  adverse  environmental  or  scene  conditions.  Under  more  favorable  con¬ 
ditions,  systems  are  contrast  limited,  and  then  only  the  modulation  transfer 
function  is  important  as  a  measure  of  resolution.”48  Performance  was  also 
observed  to  be  limited  by  clutter,  spatial  frequency  content,  or  observa¬ 
tion  time. 

Several  authors49-52  have  pointed  out  the  discrepancies  between  predicted 
and  measured  MRTs,  the  predicted  MRT  often  being  higher  than  the  measured 
MRT  at  high  frequencies  and  lower  than  predicted  at  low  frequencies.  Sug¬ 
gested  solutions  to  the  problem  have  often  centered  around  the  treatment  of 
the  observer  eye-brain  in  the  model.50-52 

2.5  STATIC  PERFORMANCE  PREDICTION 

The  laboratory  and  field  experiments  that  serve  as  the  empirical  foundation 
of  the  static  performance  model  were  first  performed  in  the  late  1950s  using 
image  intensifies,53  and  since  then  experimentation  has  been  extended  to 
include  FLIRs.  After  the  basic  prediction  methods  are  described  and  examples 
are  given,  other  prediction  methods  are  described,  and  finally  some  recent 
model  updates  are  covered. 

It  should  be  emphasized  that  the  result  of  the  prediction  of  probability  of 
detection,  recognition,  or  identification  using  the  model  discussed  is  to  be 
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compared  with  test  results  using  an  ensemble  of  observers.  The  calculation 
does  not  indicate  the  probability  that  a  single  observer  in  a  specific  scenario 
will  be  able  to  perform  a  given  task  to  a  specific  level. 

Reports  by  Greening6’54  55  provide  an  excellent  historical  perspective  on  the 
development  of  target  acquisition  modeling.  Several  models  are  compared  in 
the  reports,  and  relevant  laboratory  and  field  data  are  reviewed. 

2.5.1  Detection56 

As  described  earlier,  three  basic  types  of  detection  are  pertinent  to  target 
acquisition  modeling:  pure  detection,  discrimination  detection,  and  detection 
as  it  occurs  in  the  search  procedure. 

Pure  Detection.  The  fundamental  mechanism  of  target  acquisition  is  pure 
detection:  the  perception  of  an  object  against  a  locally  uniform  background.  It 
is  assumed  that  the  approximate  position  of  the  target  is  known,  that  is,  no 
search  for  the  target  is  required. 

The  methods  used  for  performance  prediction  of  all  EO  sensors  are  essen¬ 
tially  identical.  In  this  section  the  procedures  and  examples  have  been  spe¬ 
cialized  to  the  FLIR  case.  In  practice,  the  procedure  for  calculation  of  the 
probability  of  pure  detection  at  a  particular  range  to  the  target  can  be  broken 
into  four  steps  as  follows  (see  Fig.  2.12).  (This  procedure  is  easily  iterated  to 
determine  the  probability  of  detection  Pd  as  a  function  of  range.) 


Aj  -  Hjarg  X  Ljarg 
^^Apparent  =  ^Inherent  x 


(a) 


Fig.  2.12  Diagram  of  the  pure  detection  calculation  procedure. 
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1.  Determine  the  target’s  inherent  AT.  Calculate  the  target  area  and  the 
target’s  projected  angular  subtense  at  range  R.  Using  knowledge  of 
the  atmospheric  transmission,  calculate  the  apparent  AT  of  the  target 
at  range  R. 

2.  Calculate  or  measure  the  system  demand  function,  MDT.  Using  the 
target’s  projected  angular  subtense  at  range  R  and  the  MDT,  deter¬ 
mine  the  threshold  AT  required  to  detect  the  target. 

3.  Compute  the  signal  to  noise  of  the  target  seen  by  the  observer  as 
follows: 


SNR 


target  apparent  AT 
threshold  AT 


x  SNRti  , 


(2.23) 


where  the  threshold  SNR  for  pure  detection,  SNRri,  is  2.25. 

4.  Determine  Pd  using  the  empirical  relationship  between  SNRd  and  Pd 
shown  in  Fig.  2.13. 


Display  Signal  to  Noise  Ratio 


Fig.  2. 13  Relation  between  Pd  and  SNR  used  in  the  pure  detection  prediction  methodology. 
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Table  2.3  TOW  System  Parameters 


System 

Horizontal  FOV 

2.2  deg 

Vertical  FOV 

1.1  deg 

Frame  rate 

30  frames/s 

Interlace 

2  fields/frame 

Scan  efficiency 

0.75 

System  magnification 

12.0 

Spectral  band 

7.7-11.75  jjim 

Optics 

Effective  focal  length 

12.0  in. 

Effective  aperture  diameter 

4.5  in. 

/*/# 

2.667 

Average  optical  transmittance 

0.57 

Diffraction  wavelength 

10.0  jxm 

Blur  spot  size 

0.007  mrad2 

Detector 

Detector  IFOV* 

0.133  mrad 

Detector  IFOV-y 

0.200  mrad 

Detectors  in  parallel 

60 

Detectors  in  series 

1 

Limiting  system  noise 

Detector 

Peak  D* 

5.1  x  1010  cm  Hz^2  W 

Display 

Display  type 

EO  mux  LED  array 

Average  luminance 

10.0  mL 

LED  subtense* 

0.0625  mrad 

LED  subtensev 

0.3130  mrad 

The  lack  of  field  data  relating  displayed  SNR  and  PD  meant  that  researchers 
had  to  rely  on  the  results  of  lab  tests  by  Rosell  and  Willson33  for  the  estab¬ 
lishment  of  the  empirical  relation  shown  in  Fig.  2.13. 

Example.  A  pure  detection  prediction  example  for  an  actual  FLIR  system 
follows.  Table  2.3  lists  system  parameters  of  the  tube-launched,  optically  tracked, 
wire-guided  (TOW)  infrared  target  acquisition  system  to  be  used  in  this  ex¬ 
ample.  Figures  2.14  and  2.15  are  plots  of  further  input  to  the  MDT  calculation 
in  the  model. 

Pure  detection  performance  (as  well  as  higher  order  discrimination  perfor¬ 
mance  and  search  performance  presented  in  later  sections)  are  to  be  predicted 
for  an  M60  tank  front  for  two  atmospheric  conditions. 

Step  1  of  the  pure  detection  prediction  example  requires  the  calculation  of 
the  solid  angle  subtended  by  the  target  in  the  reference  frame  of  the  FLIR. 
The  physical  size  of  the  M60  target  front  is  3.6  m  wide  by  3.2  m  high,  resulting 
in  a  total  area  of  11.52  m2.  At  a  range  of  6  km,  the  projected  angular  subtense 
is  0.32  x  10“6sr. 

The  performance  of  the  imager  in  two  atmospheres  will  be  compared:  The 
first  is  a  "good”  atmosphere  corresponding  to  a  visibility  range  of  23  km,  rel¬ 
ative  humidity  of  50%,  and  air  temperature  of  15°C,  which  is  termed  the 
"U.S.  Standard,  Spring-Summer”  atmosphere  in  the  LOWTRAN  7  atmo¬ 
spheric  code,12  and  the  second  is  a  "poor”  atmosphere  with  a  5-km  visibility 
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Wavelength  (Microns)  Log  Frequency  (Log  Hz) 

(a)  (b) 


Log  Frequency  (Log  Hz) 

(c) 


Fig.  2.14  (a)  Spectral  D*,  (b)  system  electronics  response,  and  (c)  normalized  noise  power 
spectrum  for  the  example  system. 


range,  75%  relative  humidity,  and  an  air  temperature  of  27°C,  called  the 
"Tropical  Spring-Summer”  atmosphere.  Spectral  transmission  for  the  two 
atmospheres  is  plotted  in  Fig.  2.16. 

For  this  example,  the  inherent  A T  of  the  M60  target  is  taken  to  be  1.25°C. 
The  apparent  target  AT  will  be  a  function  of  range  due  to  the  attenuation  of 
the  signal  by  the  atmosphere.  Total  transmission  integrated  over  the  spectral 
band  of  the  TOW  system,  as  determined  using  LOWTRAN  7,  is  plotted  versus 
range  in  Fig.  2.17.  This  is  used  to  determine  the  apparent  temperature  at  a 
particular  range.  At  a  range  of  6  km  the  atmospheric  transmission  is  51%  and 
7.5%,  leading  to  apparent  AT’s  of  0.64°  and  0.093°C  for  the  good  and  poor 
atmospheres,  respectively. 

The  second  step  in  the  prediction  procedure  involves  calculation  of  the  sys¬ 
tem  MDT.  NET,  one  of  the  parameters  in  MDT,  is  calculated  first  using  Eq.  (2.19). 
Using  the  FLIR  system  descriptors  above,  the  NET  is  calculated  as  0.17°C, 
which  compares  favorably  with  laboratory  NET  measurements  of  the  TOW 
system.  MDT  is  then  calculated  using  Eq.  (2.21).  The  resulting  MDT  is  plotted 
as  a  function  of  inverse  target  size  (mrad-1)  in  Fig.  2.18. 


88  IR/EO  HANDBOOK 


Spatial  Frequency  (Cycles/mrad) 


Fig.  2.15  Optics,  detector,  display,  eye,  and  total  system  MTFs  for  the  example  system. 


Knowing  the  target  subtense  and  having  calculated  the  system  MDT,  the 
threshold  temperature  difference  required  to  just  detect  the  target  is  read  off 
the  graph  of  MDT.  The  target  size  (taken  as  the  square  root  of  the  area)  at 
6  km  subtends  0.57  mrads.  The  corresponding  inverse  target  size  is  1.77  mrad-1. 
From  the  MDT  it  is  determined  that  the  threshold  temperature  difference  is 
0.058°C.  Once  the  apparent  temperature  difference  at  a  particular  range  has 
been  determined,  the  SNR  of  the  target  is  calculated  as  in  step  3.  For  step  4 
the  probability  of  detection  is  then  simply  read  off  the  graph  of  SNR/)  versus 
Pd  in  Fig.  2.13. 

Using  the  "poor”  atmosphere,  at  a  range  of  6  km  the  SNR  of  the  target  using 
Eq.  (2.23)  is  3.6.  From  Fig.  2.13  the  corresponding  probability  of  pure  detection 
is  77%.  The  procedure  can  be  iterated  for  many  ranges  in  order  to  arrive  at  a 
graph  of  probability  of  detection  versus  range  as  has  been  done  for  Fig.  2.19. 

Although  a  number  of  laboratory  experiments  have  investigated  threshold 
detection  capability,  the  same  cannot  be  said  for  field  experiments.  Several 
factors  combine  to  make  the  field  testing  for  pure  detection  difficult,  and  as  a 
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2.16  Spectral  transmission  for  the  two  atmospheres  used  in  the  example. 


Fig.  2.17  Total  integrated  transmission  versus  range  for  the  example  atmospheres. 


Minimum  Detectable  Temperature  Difference  (Degrees  C) 
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result  there  has  not  been  a  great  deal  of  field  validation  of  the  prediction 
method  for  pure  detection. 

2.5.2  Higher  Order  Discrimination  and  the  Johnson  Methodology 

Intuitively,  it  would  seem  that  there  must  be  some  relationship  between  the 
number  of  lines  resolved  at  the  target  and  the  corresponding  decisions  of  detection, 
recognition  and  identification.53 

In  the  late  1950s  John  Johnson  investigated  the  relationship  between  the 
ability  of  an  observer  to  resolve  bar  targets  through  an  imaging  device  and 
their  ability  to  perform  the  tasks  of  detection,  recognition,  and  identification 
of  military  vehicles  through  the  same  imager.  It  is  worthwhile  to  review  his 
experiment  briefly,  along  with  what  has  become  known  as  the  equivalent  bar 
pattern  approach ,  before  discussing  higher  order  discrimination  tasks  since 
the  empirical  relationship  that  he  determined  serves  as  the  foundation  for  the 
prediction  methodology  to  be  discussed. 

In  the  laboratory,  scale  models  of  eight  different  vehicles  and  one  soldier 
were  placed  against  a  bland  background.  Observers  viewing  the  targets  through 
image  intensifies  were  asked  to  detect,  determine  the  orientation  of,  recognize, 
and  identify  the  targets.  Air  Force  bar  charts  whose  bars  had  the  same  contrast 
as  the  scale  targets  were  also  viewed  through  the  same  imager,  and  the  max¬ 
imum  resolvable  bar  pattern  frequency  was  determined  as  a  function  of  con¬ 
trast  of  the  target.  The  maximum  number  of  resolvable  cycles  across  the  target 
critical  dimension  was  determined  for  each  different  task  using 


N  —  ii/targ  '  fx  y 


where 

N  —  the  number  of  just  resolvable  cycles  across  the  target  critical 
dimension 

#targ  =  the  critical  dimension  of  the  military  target  in  milliradians, 
usually  chosen  to  be  the  minimum  dimension,  which  for 
tactical  army  vehicles  is  often  the  height 

fx  =  the  highest  resolvable  bar  pattern  fundamental  spatial 
frequency  in  cycles  per  milliradian, 

(While  reading  the  literature  on  target  acquisition,  attention  should  be  paid 
to  different  units  of  spatial  frequency  where  one  line  pair  =  one  cycle  =  a 
bar  and  a  space  between  the  bars  in  a  multiple  bar  pattern.) 

Table  2.4  shows  the  results  of  the  experiment  in  which  it  was  found  that 
the  number  of  just  resolvable  line  pairs  across  the  minimum  dimension  of  the 
target  required  to  perform  a  particular  discrimination  task  was  within  25% 
of  a  fixed  number  of  cycles.  As  long  as  the  bar  target  contrasts  equaled  the 
target-to-background  contrasts,  the  resulting  number  of  cycles  was  found  to 
be  independent  of  target-to-background  contrast  and  scene  light  level.  In  this 
manner  the  ability  of  an  observer  to  perform  discrimination  tasks  was  related 
to  their  ability  to  resolve  bar  patterns,  and,  therefore,  the  prediction  of  the 
discrimination  performance  of  the  observer  looking  through  an  EO  device  was 
simplified  to  the  prediction  of  their  ability  to  resolve  bar  patterns  through  the 
EO  system. 
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Table  2.4  Number  of  Cycles  Required  across  a  Target’s  Critical  Dimension  for 
Various  Discrimination  Tasks  (from  Ref.  53) 


Target 

Resolution  per  Minimum  Dimension 

Broadside  View 

Detection 

Orientation 

Recognition 

Identify 

Truck 

.90 

■  •  . 

4.5 

8.0 

M-48  tank 

.75 

3.5 

7.0 

Stalin  tank 

.75 

1 1 1  ’  B 

3.3 

6.0 

Centurion  tank 

.75 

3.5 

6.0 

Half-track 

1.0 

4.0 

5.0 

Jeep 

1.2 

4.5 

5.5 

Command  car 

1.2 

1.5 

4.3 

5.5 

Soldier 

1.5 

1.8 

3.8 

8.0 

105  howitzer 

1.0 

1.5 

4.8 

6.0 

Average 

1.0  ±  0.25 

1.4  ±  0.35 

4.0  ±  0.8 

6.4  ±  1.5 

Results  of  several  field  tests45  using  thermal  imagers  have  been  used  to 
establish  what  has  been  termed  the  target  transform  probability  function  (TTPF). 
Johnson  reported  in  Table  2.4  what  was  essentially  the  50%  point  (to  be  re¬ 
ferred  to  as  N50)  on  a  curve  defining  what  portion  of  an  ensemble  of  observers 
was  able  to  perform  a  particular  discrimination  task.  The  shape  of  the  TTPF 
curve  can  be  approximated  by 

=  imhof  (2.24) 

1  +  (N/Nsof 


where 

E  =  2.7  +  O.KN/N50)  .  (2.25) 

The  TTPF  curve  when  plotted  as  a  function  of  N IN 50  can  be  used  for  all 
discrimination  tasks  by  simply  associating  a  particular  N50  with  the  50% 
probability  of  performing  a  particular  task.  Such  a  curve  is  plotted  in  Fig.  2.20. 

Later  field  testing  using  FLIRs  indicated  that  the  Nbo  for  identification  was 
closer  to  8  cycles  than  6.4  as  determined  by  Johnson.  This  could  be  caused  by 
several  factors,  perhaps  primarily  the  differences  between  I2  and  FLIR  im¬ 
agery.  It  was  also  noticed  that  recognition  tasks  varied  widely  in  difficulty  so 
that  N50  varied  over  the  range  of  3  to  4  cycles.  This  led  to  a  distinction  being 
made  between  "conservative”  (4-cycle)  and  "optimistic”  (3-cycle)  recognition 
tasks.  It  should  be  stressed  that  these  N50  values  should  only  be  taken  as 
representative  values.  When  an  analyst  wishes  to  predict  the  performance  of 
a  specific  task  they  should  make  a  judgment  about  the  difficulty  of  the  task 
and  vary  N50  accordingly. 

The  procedure  for  the  prediction  of  all  of  the  higher  order  discrimination 
tasks  is  essentially  the  same  except  for  the  number  of  resolvable  cycles  required 
to  perform  the  task.  The  prediction  methodology  being  described  is  general  in 
that  the  recommended  cycle  criteria  are  the  result  of  averaging  of  test  results 
incorporating  several  situations,  observers,  clutter  levels,  target  aspects,  etc. 
Predictions  using  this  technique  will  not  reflect  the  performance  of  a  specific 
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N/N50 


Fig.  2.20  Target  transfer  probability  function  curve. 


observer  trying  to  discriminate  a  particular  target  signature,  rather  the  pre¬ 
diction  is  of  the  performance  of  an  ensemble  of  observers  viewing  a  set  of  target 
signatures.  Predictions  for  recognition  are  thought  to  be  accurate  to  ±  20% 
in  range. 

The  steps  involved  in  the  discrimination  prediction  methodology  are  as 
follows: 

1.  Determine  the  target  critical  dimension,  range,  and  inherent  AT.  Us¬ 
ing  knowledge  of  the  atmospheric  attenuation  as  a  function  of  range, 
calculate  the  apparent  AT  of  the  target  at  the  range  to  the  target  as 
described  in  the  section  on  pure  detection. 

2.  Calculate  or  measure  the  system  MRT.  From  the  apparent  AT  and 
the  MRT  determine  the  maximum  resolvable  spatial  frequency  of  the 
sensor  at  this  apparent  A  T,  /*,  in  cycles  per  milliradian. 

3.  Using  the  angular  subtense  of  the  target  critical  dimension,  i/targ/# , 
calculate  the  maximum  number  of  resolvable  cycles  across  the  target, 

N,  using 


N  =  fx 


Htarg 

~~R~ 


4.  Determine  the  probability  of  performing  a  task  from  the  TTPF  curve. 


94  IR/EO  HANDBOOK 


Fig.  2.21  Schematic  diagram  of  the  discrimination  performance  prediction  methodology. 


This  procedure  is  depicted  schematically  in  Fig.  2.21.  It  is  easy  to  iterate  the 
procedure  to  arrive  at  a  prediction  as  a  function  of  range. 

Example .  Using  the  same  3.6-  x  3.2-m  M60  tank  front  target  with  a  AT  of 
1.25°C  and  the  same  "good”  and  "bad”  atmospheres  as  described  in  Sec.  2.5.1, 
we  will  consider  the  recognition  performance  (N50  =  4  cycles)  at  a  range  of 
3  km.  For  the  "good”  atmosphere  the  transmission  at  3  km  is  65%  resulting 
in  an  apparent  AT  of  0.81°C.  The  MRT  for  the  example  TOW  system  calculated 
using  Eq.  (2.22)  is  shown  in  Fig.  2.22.  The  maximum  resolvable  frequency 
corresponding  to  an  apparent  AT  of  0.81°C  is  approximately  5.05  cycles.  The 
corresponding  number  of  resolvable  cycles  across  the  critical  dimension  of  the 
M60  target  (height  =  3.2  m)  is  approximately  5.4  cycles.  Using  the  TTPF 
curve  of  Fig.  2.20,  this  leads  to  approximately  a  75%  probability  of  recognition 
(N50  =  4  cycles).  The  same  procedure  using  the  bad  atmosphere  at  3  km  leads 
to  a  53%  probability  of  recognition.  Figure  2.23  shows  recognition  performance 
versus  range  for  the  two  atmospheric  conditions. 

It  was  thought  that  the  higher  order  discrimination  predictions  of  the  model 
would  be  more  accurate  if  the  portion  of  the  equivalent  bar  pattern  used  in 
the  prediction  (for  example,  the  four  bars  and  spaces  used  for  recognition) 
subtended  approximately  the  same  solid  angle  as  the  target.  A  target  length 
correction  was  applied  in  the  original  version  of  the  model.  It  has  the  most 
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Fig.  2.23  Recognition  performance  versus  range  for  both  atmospheres. 
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Fig.  2.24  Loadline  calculation  for  the  example  system. 


impact  on  predictions  when  the  general  shape  of  the  target  is  very  different 
in  overall  shape  from  that  portion  of  the  bar  pattern  used,  for  example,  very 
different  from  a  square  for  4-cycle  recognition,  or  different  from  a  2:7  aspect 
ratio  for  1-cycle  detection. 

For  recognition  of  tactical  ground  vehicles  where  the  target  aspect  does  not 
vary  much  from  a  square,  this  length  correction  does  not  have  much  effect. 
When  the  target  is  very  long,  such  as  is  the  case  for  a  ship,  the  correction 
becomes  significant. 

Loadline  Procedure.  Once  the  MRT  has  been  either  measured  or  calculated, 
the  process  of  estimating  range  performance  can  be  completed  using  a  rela¬ 
tively  simple  graphic  technique  sometimes  called  a  loadline  procedure .  Besides 
its  simplicity,  the  technique  has  the  advantage  of  allowing  the  analyst  to 
compare  rapidly  the  essential  relationships  between  several  imagers,  imager 
designs,  cycle  criteria,  atmospheres,  and/or  targets  all  on  the  same  graph.  The 
steps  involved  in  the  procedure,  using  the  TOW  MRT  as  an  example,  are  as 
follows  (refer  to  Fig.  2.24): 

1.  Plot  the  measured  or  calculated  MRT(s)  on  a  semilog  graph. 

2.  Knowing  the  target  critical  dimension  tftarg  and  the  number  of  cycles 
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required  to  perform  the  discrimination  task  to  the  desired  level  N, 
convert  the  frequency  axis  into  a  range  axis  using 


R 


=  f 


Htarg 

~~N~ 


3.  Knowing  the  atmospheric  extinction  and  assuming  that  Beer's  law 
adequately  approximates  the  attenuation,  apply  it  to  the  target  in¬ 
herent  AT  to  get  the  range  dependence  of  the  apparent  temperature 
difference  (Beer’s  law  is  accurate  for  monochromatic  radiation  but  is 
less  accurate  for  broadband  transmittance  because  of  the  structure  in 
the  atmospheric  absorption  spectrum.): 


ATapparent  —  ATinherent  ’  6Xp(  yR )  , 


where  y  is  the  atmospheric  extinction  coefficient  (km-1).  The  expo¬ 
nential  attenuation  when  plotted  on  a  semilog  plot  will  result  in  a 
straight  line  with  negative  slope  of  y  (the  "loadline”)  that  intersects 
the  MRT  curve  at  some  range  (=  spatial  frequency).  The  point  of 
intersection  corresponds  to  the  maximum  range  at  which  the  task  can 
be  performed  to  the  desired  level.  Keep  in  mind  that  for  each  new 
iftarg  or  N  on  the  graph,  a  new  range  axis  and  atmospheric  loadline 
must  be  drawn  even  if  the  atmospheric  transmission  is  the  same. 

Example .  For  the  TOW  example  system  the  "good”  atmosphere  was  approx¬ 
imated  by  an  atmosphere  with  a  7  of  0.16  (~85%  transmission  per  kilometer), 
and  the  "poor”  atmosphere  by  a  7  of  0.51  (~60%  transmission  per  kilometer). 
For  a  4-cycle  (50%  probability)  conservative  recognition  calculation,  the  poor 
atmosphere  results  in  approximately  3.1  km  and  the  good  atmosphere  about 
3.8  km.  These  values  differ  only  slightly  from  those  predictions  that  make  use 
of  a  more  detailed  atmosphere,  yet  we  realize  that  the  loadline  is  only  a  con¬ 
venient  tool  to  be  used  for  approximate  calculations. 

2.5.3  Discussion 

Most  of  the  targets  used  in  the  field  tests,  which  served  as  validation  for  the 
modeling  methods  for  both  detection  and  higher  order  discrimination  tasks, 
were  high-contrast  targets.  The  majority  of  the  field  trials  tested  the  observer’s 
recognition  and  identification  capability;  there  has  been  relatively  little  field 
testing  of  either  pure  or  discrimination  detection  prediction.  To  date,  the  amount 
of  data  used  to  support  the  two  detection  prediction  methods  remains  small.3,56 

The  similarity  of  a  target  signature  to  other  signatures  in  a  given  target 
signature  set  strongly  influences  the  N50  required  for  recognition.  For  a  given 
battlefield  scenario  or  field  test,  the  task  of  recognition  is  going  to  be  more 
difficult  if  the  signature  set  consists  of  signatures  that  appear  similar  rather 
than  disparate.  The  dependence  of  task  difficulty  on  the  expected  composition 
of  the  target  set  has  led  van  Meeteren57  to  propose,  for  the  purposes  of  modeling, 
that  a  standard  set  of  targets  be  decided  on  by  the  modeling  community. 

Target  aspect  can  have  a  large  effect  on  the  resolution  required  for  recog¬ 
nition  and  identification.58  Researchers  noticed  that  many  targets  were  harder 
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Fig.  2.25  Polar  diagram  indicating  the  anisotropy  of  the  cycle  criteria  for  different  vehicles 
(from  Ref.  3). 


to  recognize  from  the  front  than  from  the  side,  and  they  began  to  make  polar 
diagrams  such  as  those  in  Fig.  2.25  to  show  the  anisotropy  in  the  cycle  criteria 
for  particular  targets.  Often  there  is  an  absence  of  distinctive  features  when 
viewing  a  target  from  the  front;  however,  distinguishing  features  appear  when 
a  near  front  or  side  aspect  is  viewed.  In  a  laboratory  test  using  70  scale  models,58 
the  iVso  required  for  recognition  of  ground  vehicles  did  not  increase  by  more 
than  approximately  30%  in  going  from  the  side  to  the  front  aspect.  However, 
for  targets  with  larger  length-to-width  ratios  such  as  battleships  and  aircraft 
carriers  the  anisotropy  in  N§o  for  recognition  and  identification  was  more 
pronounced,  sometimes  being  as  much  as  a  factor  of  5  between  the  side  and 
front  aspects. 
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The  authors  of  Ref.  3  summarized  the  limitations  of  their  model  in  the  1975 
model  documentation.  They  mentioned  the  lack  of  validation  for  detection  and 
higher  order  discrimination  tasks  using  low  AT  targets,  and  they  expressed 
the  need  for  a  "complex  target  model”  and  a  more  suitable  way  to  choose  the 
critical  dimension  of  the  target  than  simply  the  minimum  dimension.  They 
planned  to  incorporate  the  target  aspect  variation  of  Prec  into  a  future  version 
of  the  model. 

It  was  realized  that  the  resolution  of  an  imaging  system  in  two  dimensions 
should  be  accounted  for  in  a  performance  prediction  methodology.  Prediction 
of  the  MRT  perpendicular  to  the  scan  direction,  MRTy,  as  well  as  a  "45 -degree 
MRT”  were  included  in  the  model  even  though  they  were  hardly  ever  measured 
in  the  laboratory  and  were  not  used  in  predictions. 


2.5.4  Other  Static  Performance  Models 

Section  2.5.2  described  a  model  that  is  one  of  the  most  widely  used  performance 
models  and  that  has  served  as  the  basis  for  several  other  similar  models.  The 
model  is  being  enhanced  in  order  to  improve  the  prediction  accuracy  for  modern 
thermal  imagers.  Before  the  more  recent  imagers  and  model  enhancements 
are  described,  it  is  instructive  to  compare  the  form  of  some  other  static  per¬ 
formance  models. 

One  of  the  reasons  for  trying  to  account  for  the  system  resolution  in  both 
directions  in  a  performance  model  is  related  to  the  typical  target  description 
used  in  the  models.  As  related  earlier,  for  some  targets  N$o  has  a  strong 
dependence  on  target  aspect.  This  led  system  analysts  to  develop  models  that 
used  the  number  of  resolvable  areas,  or  pixels,  on  target,  instead  of  the  number 
of  resolvable  bars  across  a  critical  dimension  as  a  criterion  for  whether  an 
observer  could  perform  a  discrimination  task.59-61  It  was  assumed  that  the 
target  area  more  accurately  reflected  the  information  from  the  image  than  did 
a  critical  dimension.  The  resolvable  pixel  was  a  function  of  resolution  in  both 
the  scan  and  orthoscan  directions.  This  approach  has  the  advantage  of  not 
requiring  the  analyst  to  select  a  target  critical  dimension.  The  whole  target 
projected  area  can  then  be  used,  a  fact  that  is  more  important  for  targets  with 
nonsquare  aspect  ratios  such  as  ships. 

Moser’s60  work  was  one  of  the  early  efforts  to  relate  empirically  the  number 
of  pixels  on  target  to  the  probability  of  performing  a  discrimination  task. 
Through  laboratory  testing  using  black-and-white  ship  silhouettes  presented 
as  a  mosaic  of  square  tiles  or  "pixels,”  he  determined  that  the  approximate 
number  of  pixels  needed  to  perform  ship  classification  (distinguish  a  commer¬ 
cial  vessel  from  a  warship)  was  approximately  66.  The  number  of  pixels  re¬ 
quired  for  identification  (deciding  on  the  class  of  ship)  was  around  400.  These 
numbers  were  used  as  discrimination  criteria  in  a  prediction  method  that 
involved  resolvable  pixels. 

O’Neill’s61  work  also  included  an  investigation  of  the  number  of  resolvable 
pixels  required  to  perform  discrimination  tasks.  He  used  an  active  range-gated 
low-light-level  TV  in  the  laboratory  to  image  scale  models  of  ships.  The  number 
of  resolvable  pixels  required  to  perform  discrimination  tasks  similar  to  those 
in  Moser’s  study  were  reported  to  be  significantly  higher:  400  resolvable  pixels 
versus  66  square  pixels  for  classification  and  1000  versus  400  for  identification. 
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However,  the  imagery  in  the  two  studies  was  significantly  different.  The  tar¬ 
gets  in  Moser’s  study  were  black-and-white  tiled  silhouettes  whereas  O’Neill’s 
were  TV  images  of  models. 

Another  major  conclusion  of  O’Neill’s  work  was  that  there  was  not  a  close 
relation  between  image  detail  and  bar  pattern  resolution.  As  the  SNR  de¬ 
creased,  the  number  of  resolvable  pixels  required  to  perform  a  given  discrim¬ 
ination  task  increased.  Flaherty’s  work62  on  image  intensifies  also  showed 
evidence  for  increasing  N50  with  decreasing  light  levels  (decreasing  SNRs). 

Rosell  and  Willson  measured  threshold  signal-to-noise  values  (SNR d)  for 
bar  patterns  of  varying  spatial  frequency.  They  found  that  the  threshold  varied, 
being  as  high  as  4  at  lower  spatial  frequencies  and  near  1.5  at  high  frequencies. 
In  an  approach  similar  to  that  described  in  Sec.  2.5.2,  Sendall  and  Rosell52 
advocate  the  use  of  a  variable  threshold  SNRd,  fixed  at  2.5  below  400  TV  lines 
per  picture  height  and  decreasing  above  that  frequency. 

The  point  was  made  by  Rosell63  that  system  performance  can  be  limited 
either  by  noise  or  by  system  MTF  ("aperture  limited”).  It  was  observed  that 
more  resolution  is  required  to  perform  a  particular  discrimination  task  using 
a  sensor  that  is  noise  limited  rather  than  aperture  limited,  and  that  a  future 
prediction  method  should  account  for  the  possibility  of  both  cases.  Rosell  has 
also  suggested  that  performance  predictions  would  be  more  accurate  if  some 
account  were  taken  of  the  variation  of  threshold  SNR  with  bar  pattern 
frequency.52 

Van  Meeteren64’65  and  Vos  and  van  Meeteren66  examined  observer  perfor¬ 
mance  of  discrimination  tasks  viewing  projected  images  of  tactical  ground 
vehicles  through  an  image  intensifier.  He  formulated  a  model  that  related  the 
performance  of  various  discrimination  tasks  with  the  ability  of  an  observer  to 
detect  various  size  disks.  For  his  chosen  set  of  six  targets  he  found  that  50% 
probability  of  recognition  is  equivalent  to  detection  of  a  disk  with  a  diameter 
of  0.7  m. 

Blumenthal  and  Campana67,68  investigated  several  image  quality  metrics 
and  their  relation  to  subjective  ranking  of  image  quality.  Results  of  testing 
suggested  that  image  quality  was  inversely  proportional  to  the  size  of  a  barely 
detectable  object,  leading  the  investigators  to  promote  an  "aperiodic  detection 
model”  that,  like  van  Meeteren’s  approach,  relates  detectability  of  a  circle  or 
square  with  the  discriminability  of  military  targets. 

Task69  investigated  19  display  system  figures  of  merit,  most  of  which  were 
broadband.  He  did  not  come  up  with  a  specific  performance  model.  Yet,  he  did 
find  that  the  figures  of  merit  that  had  the  highest  correlation  with  observer 
performance  of  discrimination  tasks  involving  tactical  military  vehicles  were 
those  measures  that  had  been  logarithmically  transformed  so  that  they  were 
weighted  properly  in  terms  of  visual  information  content. 

Moser  questioned  the  basic  assumptions  of  these  performance  methodolo¬ 
gies,  namely,  whether  "the  amount  of  identifying  information  conveyed  by  a 
target  image  is  a  function  of  the  projected  area  of  the  target.”60  He  pointed 
out  that  most  of  the  projected  area  of  a  ship  is  relatively  featureless,  and  most 
of  the  identifying  information  is  in  the  superstructure.  He  went  on  to  say 
"Perhaps  a  better  measure  of  information  content  would  be  the  resolvable 
perimeter  of  the  target  or  the  number  of  resolvable  angles  along  its  perime¬ 
ter.”60  One  performance  model  somewhat  along  those  lines  has  been  described 
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by  Overington.5,70  He  postulates  that  detection  and  higher  order  discrimina¬ 
tion  performance  can  be  related  to  the  resolvability  of  fractions  of  a  target’s 
perimeter,  the  smaller  the  resolvable  fraction  of  the  perimeter,  the  higher  the 
order  discrimination  task  that  is  possible. 

2.5.5  Recent  FUR  Systems  and  Performance  Models 

The  limitations  of  the  one  dimensional  (1-D)  modeling  approach  described  in 
Sec.  2.5.2  became  more  pronounced  as  FLIR  system  designs  deviated  more  and 
more  from  typical  first-generation  systems.  Some  features  of  more  modern 
FLIR  systems  that  can  significantly  influence  system  performance  and  which 
are  not  addressed  in  the  1-D  model  are  now  discussed  in  more  detail. 

Sampling.  The  influence  of  spatial  sampling71-74  was  neglected  in  the  pre¬ 
vious  MRT  derivation.  The  image  was  not  sampled  along  a  scan  line  for  first- 
generation  FLIR  systems  and  so,  at  least  for  prediction  of  MRT  parallel  to  scan 
(bars  oriented  perpendicular  to  the  scan  direction),  sampling  effects  were  not 
a  factor.  Still,  for  newer  scanning  and  staring  sensors  that  are  sampled  in  two 
dimensions,  sampling  can  play  a  larger  role. 

The  resolution  of  an  imaging  system  has  commonly  been  equated  with  its 
IFOV  size  when  in  reality  an  observer’s  ability  to  resolve  objects  in  an  image 
can  be  limited  by  a  host  of  factors  including  the  finite  spacing  between  samples. 
In  most  EO  imaging  systems,  the  image  is  sampled  both  spatially  and  tem¬ 
porally.  As  explained  in  Sec.  2.3.3,  a  parallel  scanned  FLIR  spatially  samples 
an  input  scene  perpendicular  to  the  scan  direction  by  virtue  of  the  spacing  of 
the  detectors  on  the  array.  For  detector  arrays  that  employ  charge  transfer 
devices  to  read  signals  off  the  focal  plane  (see  the  second-generation  system 
depicted  in  Fig.  2.3),  each  detector  temporally  samples  the  scene  as  it  scans 
across  the  FOV. 

Previous  discussion  of  FLIR  components  showed  that  many  tended  to  low- 
pass  filter  an  input  signal  resulting  in  a  band-limited  signal.  Periodic 
sampling16,71  of  a  band-limited  signal,  either  in  time  or  space,  creates  replicas 
of  the  baseband  signal  in  the  frequency  domain  centered  on  integer  multiples 
of  the  sampling  frequency  fs.  The  Nyquist  frequency,  /5v,  is  defined  to  be  fsl 2. 
See  Fig.  2.26  for  1-D  frequency-domain  representations  of  the  baseband  and 
sidebands  for  three  different  sampling  rates. 

If  the  sampling  rate  is  chosen  such  that  the  limiting  frequency  of  the  signal 
being  sampled  is  greater  than  fa,  the  signal  is  said  to  be  undersampled.  The 
sidebands  and  baseband  will  overlap  as  in  Fig.  2.26(a),  causing  what  is  termed 
aliasing.  A  spatial  frequency  fx  greater  than  fa  and  sampled  at  fs  will  result 
in  an  attenuated  output  signal  at  fs  -  fx .  Within  the  overlapping  frequency 
band  there  is  an  ambiguity  since  it  is  impossible  to  know  whether  the  output 
frequency  resulted  from  an  input  frequency  of  f  or  fs  -  f 

The  aliased  signal  can  sometimes  result  in  jagged  edges  in  an  image.  Also, 
undersampled  systems  can  exhibit  a  shift  variance,  a  dependence  of  the  system 
PSF  on  position  in  the  image,  which  can  lead  to  difficulties  in  the  definition 
of  MRT.  The  appearance  of  the  four-bar  MRT  target  will  depend  on  the  relative 
phasing  of  the  sampling  grid  and  the  target,  a  phenomenon  that  has  been 
called  the  sample-scene  phase  effect ,75  The  shift  variance  does  not  allow  the 
strict  application  of  linear  system  theory  to  systems  modeling. 
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Fig.  2.26  Frequency-domain  representations  of  the  influence  of  different  sampling  rates 
corresponding  to  (a)  undersampling,  (b)  critical  sampling,  and  (c)  oversampling. 


life  is  increased  to  the  point  that  the  limiting  frequency  of  the  band-limited 
signal  is  just  equal  to  /w,  as  shown  in  Fig.  2.26(b),  then  the  signal  is  said  to 
be  critically  sampled.  Here  the  sampled  signal  will  not  exhibit  any  aliasing 
or  sample-scene  phase  effects  if  the  signal  is  properly  reconstructed.  A  perfect 
low-pass  postsample  filter  cutting  off  frequencies  greater  than  fsT  will  com¬ 
pletely  remove  any  sidebands,  leaving  only  the  original  baseband  signal,  ex¬ 
actly  reconstructing  the  input  to  the  sampler.  Good  approximations  to  a  perfect 
low-pass  filter  will  cut  off  near  /at  with  little  attenuation  of  the  high  baseband 
frequencies  and  little  contribution  from  the  sidebands.  Increasing  the  sampling 
rate  still  further  results  in  oversampling  [Fig.  2.26(c)],  where  the  baseband 
and  sideband  do  not  overlap  at  all.  Again,  no  aliasing  or  phasing  effects  will 
be  seen  after  proper  reconstruction. 

One  way  in  which  systems  analysts  have  tried  to  account  for  the  influence 
of  sampling  in  performance  prediction  is  to  assume  that  the  MRT  asymptotes 
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at  fN.  Calculations  involving  frequencies  greater  than/iv  are  not  allowed.  Other 
methods  of  modeling  the  effects  of  sampling  have  been  mentioned  in  the  lit¬ 
erature.  As  one  way  to  account  for  the  influence  of  sample-scene  phasing, 
Park73  describes  an  MTF  that  has  been  averaged  over  all  possible  phases  of 
the  sampling  grid  with  respect  to  the  scene.  Rosell76  also  recommends  an  MTF 
that  is  an  average  of  the  MTFs  corresponding  to  the  best  and  worst  sample- 
scene  phases.  These  averaged  MTFs  are  perhaps  appropriate  for  field  perfor¬ 
mance  predictions  where  all  phases  are  possible,  but,  for  prediction  of  labo¬ 
ratory  measurements  of  MRT  where  only  one  phase  is  used,  they  are  not 
suitable.  Kennedy44  advocates  treating  the  aliased  part  of  the  signal  spectrum 
as  a  contribution  to  the  noise  power  spectrum. 

Although  a  few  investigations  of  the  influence  of  sampling  on  observer 
performance  have  been  performed,13-15  a  complete  understanding  of  the  influ¬ 
ence  of  sampling  rate  and  the  related  presample  and  postsample  filtering  on 
observer  performance  remains  a  topic  for  future  research. 

Nonuniformity.  For  imaging  systems  employing  multiple  detectors,  the  re¬ 
sponse  to  an  input  signal  can  vary  from  detector  to  detector.  If  the  response 
variation  is  not  corrected,  the  resulting  imagery  will  exhibit  a  fixed-pattern 
noise .  Several  sources  have  been  mentioned  as  possible  contributors  to  the 
nonuniformity,  for  example,  nonuniform  thermal  reference  sources,  electrical 
and  optical  crosstalk,  and  nonlinear  detector  channel  transfer  functions.  For 
staring  sensors  the  uncorrected  nonuniformity  can  result  in  a  stationary  "wind¬ 
shield  mud”  pattern  superimposed  on  the  imager.  For  a  parallel  scanned  array, 
the  uncorrected  image  will  have  pronounced  streaks  along  the  scan  direction. 

The  1-D  system  performance  model  discussed  in  Sec.  2.5.2  was  not  developed 
or  validated  using  imagery  where  the  fixed  pattern  noise  was  a  significant 
contributor  to  the  visible  noise.  In  the  derivation  of  system-level  figure  of  merit, 
it  was  assumed  that  "well-behaved”  temporal  noise  limited  observer  perfor¬ 
mance.  Fundamental  perception  experiments  will  have  to  be  done  to  quantify 
the  influence  of  various  amounts  of  fixed  pattern  noise  on  an  observer’s  ability 
to  perform  various  system  discrimination  tasks. 

Incorporation  of  the  fixed  pattern  noise  into  a  performance  modeling  scheme 
requires  the  realization  that  the  temporal  summation  of  the  eye  incoherently 
sums  white  noise  while  it  coherently  sums  the  noise  due  to  nonuniformities. 
For  details  on  several  efforts  to  include  nonuniformity  effects  in  performance 
models  see  Cantella,77  Rosell,78  Kennedy,44  Mooney,79  and  D’Agostino.80 


Charge  Transfer  Devices.  The  signal  from  each  detector  of  first-generation 
systems  was  read  off  the  focal  plane  and  out  of  the  dewar  on  a  separate  lead. 
In  contrast,  modern  systems  usually  read  signals  off  the  focal  plane  using  some 
sort  of  charge  transfer  device,  the  signals  from  which  are  then  multiplexed 
and  read  out  of  the  dewar. 

If  a  charge-coupled  device  (CCD)  is  used  to  read  signals  off  the  focal  plane, 
then  the  transfer  function  due  to  integration  of  the  charge  for  the  duty  cycle 
of  the  CCD  is  given  by 


Hinteg(fx)  —  sincCorAXsample/i)  > 


(2.26) 


104  IR/EO  HANDBOOK 


where  Axsampie is  the  angular  subtense  of  a  single  sample  in  milliradians.  This 
replaces  the  first-generation  single-pole  temporal  rolloff  of  the  detector.  One 
can  account  for  the  charge  transfer  inefficiency  using 


Hccuif) 


(2.27) 


where 

n  —  number  of  cells  in  the  CCD  shift  register 
f  -  input  signal  spatial  frequency 

/sample  =  frequency  at  which  the  CCD  samples  the  signal 
e  =  charge  transfer  efficiency. 

These  MTFs  apply  along  the  direction  of  the  readout.  If  a  multiplexing  stage 
is  used  after  the  readout  CCDs,  the  response  of  the  multiplexer  is  accounted 
for  using  the  CCD  equations  with  appropriate  changes  for  the  sampling  fre¬ 
quency,  number  of  transfers,  and  transfer  efficiency. 

Reconstruction.  Often  the  only  reconstruction  performed  on  the  signal  before 
final  reconstruction  at  the  display  is  a  simple  sample-and-hold  circuit  that 
implies  that  the  filtering  done  on  the  signal  has  the  form 


Hrecon(fx)  =  sinctirAXsample/x) 


(2.28) 


Higher  order  reconstruction  filters  (e.g.,  linear  interpolation,  cubic  spline, 
Butterworth)  would  require  substitution  of  the  appropriate  function  for  HreCon(fx)- 

Image  Processing.  Several  real-time  image  processing  operations  can  be  im¬ 
plemented  in  the  digital  processing  chain  of  current  imagers,  many  of  which 
are  nonlinear  operations  and  as  such  cannot  be  inserted  into  the  present  linear 
systems  formulation  of  performance  models  as  simple  MTFs.  Automatic  gain 
and  level  controls  are  typical  features  of  current  imagers.  Histogram  modifi¬ 
cation  techniques  can  be  used  to  display  optimally  a  signal  with  a  large  dy¬ 
namic  range.  Although  their  influence  on  performance  can  be  significant,  their 
incorporation  into  performance  models  is  not  straightforward. 

Horizontal  and  Vertical  Resolution.  First-generation  parallel  scanning  de¬ 
tector  arrays  were  standardized  around  only  a  few  designs.  The  resolution  of 
the  systems,  as  evidenced  by  typical  system  MRTs,  perpendicular  to  scan  was 
around  half  that  parallel  to  scan.  Second-generation  FLIR  systems  were  built 
that  had  nearly  equal  resolution  along  the  scan  direction  and  perpendicular 
to  it.  It  seemed  logical  that  the  improved  resolution  perpendicular  to  the  scan 
direction  should  result  in  an  improvement  in  predicted  performance,  a  pre¬ 
diction  that  was  not  possible  using  a  1-D  model. 

Some  experimental  evidence  exists  corroborating  the  hypothesis  that  in¬ 
creased  vertical  resolution  improves  observer  performance.  The  results  of  much 
of  the  related  testing  are  complicated  by  the  fact  that  vertical  and  horizontal 
resolution  parameters  are  not  treated  separately.  Results  of  tests  where  the 
number  of  TV  raster  lines  subtending  the  height  of  a  target  (and  therefore  the 
vertical  sample  spacing)  was  varied  indicate  better  discrimination  capability 
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for  an  increased  number  of  raster  lines.  Precise  quantification  of  the  relative 
importance  of  vertical  and  horizontal  resolution  has  been  difficult  since  ex¬ 
perimental  results  were  often  confounded  by  the  presence  of  a  strong  raster 
effect.  For  description  of  some  of  these  experiments  see  Williams  and  Erickson81 
and  studies  summarized  in  Farrell  and  Booth.24  Only  a  few  studies  have  treated 
sample  spacing  and  IFOV  size  variations  along  each  dimension  separately.13-15 

Many  researchers  have  proposed  two-dimensional  variations  of  the  equiv¬ 
alent  bar  pattern  approach.59’82’83  Instead  of  calculating  the  number  of  resolved 
bars  across  a  critical  dimension  of  a  target,  some  approaches  use  the  number 
of  resolvable  pixels  on  target  calculated  using  a  formula  such  as59 


^pixels  —  2iV cycles*  27VcyClesy  — 


4 fx  fyLtargHtarg 


(2.29) 


where 

fx,fy  =  just  resolvable  frequencies  determined  from  the  MRT  in 

each  direction 

R  —  range  in  kilometers 

LtargMtarg  =  target  length,  height  in  meters. 

The  shape  of  a  resolvable  pixel  will,  in  general,  reflect  any  asymmetry  in  the 
threshold  resolution  capability  of  the  imager.  The  size  of  the  resolvable  pixel, 
1/(4 fxfy),  will  change  depending  on  the  apparent  thermal  contrast.  A  TTPF 
curve  relating  number  of  resolvable  pixels  on  target  to  probability  of  perform¬ 
ing  a  task  is  then  used. 

A  second,  similar  approach  is  to  measure  the  MRT  in  each  direction  and 
then  average  the  two.  A  TTPF  curve  using  cycles  across  a  particular  di¬ 
mension  of  a  target  can  then  be  used  (the  dimension  is  sometimes  chosen 
to  be  the  square  root  of  the  area),  the  N$o  point  being  adjusted  from  that  in 
Fig.  2.20  depending  on  the  averaging  technique  used  and  the  choice  of  target 
dimension. 

An  updated  version84,85  of  the  static  performance  model  discussed  in  detail 
in  Sec.  2.5.2  was  issued  in  June  1990.  The  model  update  consisted  of  two  parts: 
"FLIR90,”  which  predicts  laboratory  measures,  and  "Acquire,’'  which  predicts 
field  performance.  In  FLIR90,  predicted  or  measured  horizontal  and  vertical 
MRTs  are  averaged  at  a  particular  temperature  using 

/el ff  =  (fx  ■  fyf 1  ■  (2.30) 

The  "effective”  MRT  is  used  along  with  modified  values  of  N50  for  the  different 
discrimination  tasks  to  predict  range  performance.  The  N50  for  a  particular 
task  using  the  more  recent  2-D  version  of  the  model  is  found  by  multiplying 
the  original  "1-D”  N50  values  by  0.75.  The  amount  of  shift  was  determined  by 
requiring  the  range  predictions  for  the  2-D  model  to  predict  correctly  the  results 
of  the  field  tests,  which  served  as  validation  for  the  original  model. 

The  target  model  used  in  this  version  of  the  model  uses  a  rectangular  target 
characterized  by  A?2  instead  of  the  smallest  dimension  as  in  the  previous 
version.  This  target  description  is  thought  to  be  appropriate  for  tactical  army 
targets  that  are  normally  near  square,  yet  the  description  may  need  refinement 
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for  targets  with  drastically  different  aspect  ratios  such  as  ship  targets.  The 
influence  of  aliasing  is  handled  in  the  model  update  by  assuming  the  MRT 
cuts  off  at  fw.  While  the  MRT  predictions  still  tend  to  be  slightly  optimistic 
at  low  spatial  frequencies  and  pessimistic  at  high  spatial  frequencies,  the 
agreement  with  MRT  measurements  is  significantly  better  than  the  original 
static  performance  model. 

The  original  version  of  the  performance  model  relied  on  NET  to  completely 
describe  the  system  noise.  Measurement  of  prototype  second-generation  sys¬ 
tems  showed  that  MRT  measurements  could  be  dominated  by  different  types 
of  noise  such  as  pronounced  readout  noise  or  the  streaking  due  to  nonuniform¬ 
ity.  Along  with  FLIR90  a  framework  is  provided  for  the  description  of  noise 
terms  in  the  MRT  that  account  for  what  was  termed  directional  noise ,  that  is, 
measured  noise  or  nonuniformity  defined  in  a  three-dimensional  coordinate 
system  (temporal,  horizontal  spatial,  and  vertical  spatial),80  and  a  standard 
laboratory  measurement  procedure86  is  specified.  The  noise  analysis  meth¬ 
odology  isolates  system  noise  into  eight  directional  components.  Each  com¬ 
ponent  is  multiplied  by  the  appropriate  temporal  or  spatial  integration  factors, 
and  horizontal  and  vertical  components  are  summed  to  get  correction  factors 
in  the  MRT  equation.  The  influence  of  each  of  the  noise  components  on  both 
MRT  and  field  performance  is  being  actively  investigated. 

There  have  been  some  efforts  to  quantify  the  performance  of  staring  systems. 
Cantella77  expresses  typical  system-level  descriptors  such  as  MRT  in  terms  of 
electron  density  at  the  focal  plane.  Nonuniformity  is  accounted  for  as  an  ad¬ 
ditive  noise  term.  Aliased  signal  and  noise  is  not  dealt  with.  Rosell78,87  develops 
expressions  for  NET  and  MRT  of  staring  arrays  that  include  the  influence  of 
nonuniformity  in  a  similar  manner.  Shaham  and  Woody88  present  an  MRT 
that  includes  an  aliased  noise  term.  For  the  systems  they  considered,  the 
sampling  rate  is  assumed  to  be  high  enough  that  signal  aliasing  can  be  ne¬ 
glected.  Kennedy44,59  treats  aliased  signal  and  noise  as  well  as  other  charac¬ 
teristics  such  as  nonuniformity  in  his  2-D  model.  A  more  recent  update89,90  of 
the  Night  Vision  and  Electro-Optics  Directorate  model,  FLIR92,  includes  the 
capability  to  model  staring  systems.  Sample-scene  phasing  effects  are  ac¬ 
counted  for  using  an  averaged  MTF.  Predictions  are  not  allowed  using  MRT 
frequencies  beyond  the  Nyquist  frequency  in  order  to  account  for  aliasing. 

It  has  been  pointed  out  that  most  of  the  so-called  two-dimensional  models 
are  really  two  directional  instead.  That  is,  threshold  resolution  performance 
is  predicted  or  measured  along  two  directions  90  deg  apart;  resolution  of  the 
imager  along  intermediate  directions  is  not  used  in  the  models.  Such  two- 
directional  models  would  predict  no  advantage  for  hexagonal  sampling  schemes, 
which  have  been  shown  to  be  the  best  sampling  scheme  for  natural  scenes.72 

Initial  steps  have  been  taken  to  add  to  the  validation  data  base  for  the  2-D 
models  using  the  field  test  results  of  second-generation  thermal  imagers.  Given 
recent  improvements  in  detector  technology  and  digital  processing,  the  rapid 
pace  of  development  of  EO  sensor  technology  will  continue  to  provide  systems 
analysts  with  a  challenge  for  the  future. 

2.6  SEARCH  PERFORMANCE  MODELING91"96 

Bloomfield92  categorizes  several  situations  in  which  an  observer  would  need 
to  perform  visual  search.  One  condition  requiring  search  has  been  termed 
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competition :  the  circumstance  where  the  target  and  other  nontargets  (for  ex¬ 
ample,  other  vehicles  or  parts  of  the  background)  resemble  each  other  to  some 
degree.  Partial  obscuration  of  the  target  by  smoke,  defilade,  or  camouflage  will 
increase  the  degree  of  competition  and,  therefore,  the  difficulty  of  the  search 
task.  Another  situation  where  search  is  needed  arises  when  the  target  is  so 
close  in  luminance  to  the  background  that  it  is  near  the  threshold  of  detect¬ 
ability,  a  condition  that  has  been  termed,  logically,  a  threshold  situation.  Also, 
search  would  be  needed  even  if  the  target  could  be  easily  discerned  from  the 
background  but,  by  virtue  of  its  very  small  size,  was  difficult  to  find. 

2.6.1  The  Search  Process 

The  previous  discussion  of  static  performance  focused  on  prediction  of  tasks 
where  the  target  position  is  approximately  known  and  the  time  required  to 
perform  the  task  is  not  a  critical  variable.  For  static  performance  tasks  it  is 
assumed  that  the  observer  can  take  as  long  as  needed  to  perform  a  given  task. 
In  this  section  emphasis  is  on  the  prediction  of  search  tasks  where  target 
position  is  unknown  and  time  is  a  critical  variable. 

A  general  search  task  will  often  involve  an  EO  system,  the  LOS  of  which 
can  be  panned  through  specified  angles  in  elevation  and  azimuth  either  au¬ 
tomatically  or  manually.  The  segment  of  object  space  that  can  be  imaged  by 
virtue  of  this  panning  forms  the  system  field  of  regard  (FOR).  The  search  field 
is  defined  as  "the  area  of  object  space  which  is  physically  covered  by  the  device 
in  quest  of  the  target,  to  the  exclusion  of  other  areas”11  Since  the  FOR  will 
frequently  include  regions  where  the  target  cannot  possibly  exist  (i.e.,  a  tank 
in  the  sky  or  on  a  very  steep  slope),  the  search  field  will  often  be  smaller  than 
the  system  FOR. 

The  process  of  location  of  a  target  using  an  EO  system  can  often  be  con¬ 
veniently  partitioned  into  two  main  processes:  physical  search,  or  panning  the 
system  FOV  to  examine  the  FOR,  and  display  search  (sometimes  called  FOV 
search),  which  involves  visually  sampling  the  EO  display.  Figure  2.27  is  a  flow 
diagram  of  a  simplified  search  procedure  involving  display  search  for  a  single 
target  in  a  search  field.  It  has  been  noticed  in  several  search  experiments  that 
when  an  image  is  first  presented  to  an  observer,  they  scan  the  whole  image 
quickly  to  orient  themselves  in  the  image.  Any  contextual  features  of  the  scene 
found  during  the  orientation  that  can  be  used  to  reduce  the  size  of  the  search 
field  will  lead  to  reduced  mean  search  times.  For  example,  an  observer  looks 
for  ground  vehicles  first  along  or  near  a  road. 

The  search  process  proceeds  with  a  series  of  visual  interrogations  of  fixation 
points  and  decisions  as  to  the  presence  of  a  target.  If  the  target  has  not  been 
found  after  an  investigation  of  the  FOV,  the  sensor  LOS  is  repositioned,  the 
observer  orients  him-  or  herself  in  the  portion  of  the  search  field  being  dis¬ 
played,  and  the  process  of  display  search  repeats  itself. 

Eye  Movements  and  Visual  Search.959798  The  human  eye  searches  a  display 
by  aiming  the  fovea  at  different  locations  in  an  image,  rapidly  moving  from 
one  fixation  point  to  another.  Each  fixation  lasts  about  a  third  of  a  second  on 
the  average.  The  large  jumps  are  called  saccades ;  a  saccade  plus  a  fixation  is 
termed  a  glimpse.  The  saccades  last  only  a  few  milliseconds  and  can  reach 
speeds  of  1000  deg/s.  During  the  saccadic  motion,  vision  is  greatly  reduced. 
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Fig.  2.27  Search  flow  diagram  (after  Ref.  97). 


The  speed  and  length  of  the  saccade  are  dependent  on  the  task,  being  faster 
for  situations  where,  for  example,  the  allowed  time  to  perform  the  search  is 
limited  to  a  short  interval,  and  being  physically  shorter  when  the  density  of 
information  in  the  image  is  higher.  For  more  complicated  scenes,  the  fovea 
will  tend  to  interrogate  areas  of  high  information  content.  The  choice  of  the 
areas  to  interrogate  will  be  governed  in  part  by  the  observer’s  expectations 
and  by  the  information  desired  from  the  image.  Obviously  the  characteristic 
motion  of  the  eye  will  play  a  central  role  in  the  ability  of  an  observer  to  perform 
visual  search;  therefore,  models  of  visual  search  must  explicitly  or  implicitly 
account  for  some  aspects  of  typical  eye  motion. 

2.6.2  Factors  That  Influence  Search  Performance 

As  emphasized  in  Table  2.2,  numerous  factors  influence  an  observer’s  ability 
to  acquire  a  target.  Only  some  of  the  major  considerations  are  discussed 
here.92’"-101 

For  competition  search,  as  would  be  expected,  the  more  the  target  differs 
from  the  nontargets  in  contrast,102  shape,  or  size,103-105  the  faster  the  target 
will  be  found.  This  assumes  that  other  factors  such  as  the  number  of  targets 
and  the  target  density  are  kept  constant.  Any  other  factors  that  would  act  to 
increase  the  target  discriminability  would  also  lead  to  decreased  mean  search 
times. 

Also,  as  might  be  expected,  increasing  the  number  of  nontargets,  their  homo¬ 
geneity,  or  the  size  of  the  search  field  will  generally  result  in  increased  mean 
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search  times.  Any  change  to  the  displayed  image  that  would  require  an  ob¬ 
server  either  to  examine  more  objects,  or  to  examine  the  objects  in  greater 
detail,  will  lengthen  the  search  process. 

Kaplan  and  Carvellas106  found  that  an  observer,  while  first  training  on  a 
set  of  targets  (in  their  case,  letters  of  the  alphabet),  will  scan  more  slowly 
while  searching  through  a  list  for  one  of  many  targets.  Neisser107  points  out 
that  after  learning  the  target  set  thoroughly  an  observer  can  scan  through  a 
list  looking  for  one  of  many  targets  in  a  target  set  just  as  fast  as  when  scanning 
for  a  single  target.  Yonas  and  Pittinger108  state  that  even  though  the  scan 
rate  for  multiple  targets  may  be  the  same  after  learning,  the  error  rates  in¬ 
crease.  Practice  also  can  improve  the  performance  of  tasks  such  as  threshold 
detection  that  do  not  involve  learning  the  shapes  or  characteristic  features  of 
targets. 

If  the  observer  has  been  prebriefed  so  that  he  or  she  knows  probable  positions 
or  states  of  the  target,  mean  search  times  will  be  shorter.  On  the  other  hand, 
if  a  target  does  not  appear  very  much  like  the  mental  image  of  the  target  that 
has  been  learned  by  the  observer,  the  search  process  will  be  more  difficult.  If 
the  target  is  camouflaged  or  partially  occluded,  the  target  discriminability 
from  background  decreases  and  the  search  process  becomes  correspondingly 
more  difficult.109 

Search  strategies  for  the  motion  of  the  sensor  LOS  in  a  physical  search  task 
have  been  shown  to  have  a  large  influence  on  total  search  performance.  The 
recommendations  of  one  study110  call  for  a  regular  physical  search  pattern 
that  produces  systematic  and  comprehensive  coverage  of  the  search  field  and 
the  use  of  a  variable  scan  rate  that  is  adjusted  to  the  difficulty  of  terrain  being 
investigated. 


2.6.3  Search  Modeling6 111 112 113 

The  mathematical  forms  of  military  search  models  often  have  their  roots  in 
basic  perception  experiments,  many  of  which  were  performed  to  investigate 
nonmilitary  applications  of  search  such  as  reading  or  assembly  line  quality 
control.  Some  field  testing  for  specialized  military  scenarios  exists  (see  Ref. 
114,  for  example),  but  usually  the  cost  of  carrying  out  extensive,  well- 
instrumented  field  validation  trials  in  a  realistic  military  environment  is  pro¬ 
hibitive.  Because  of  this,  for  specific  scenarios  such  as  the  tactical  ground-to- 
ground  case,  only  a  small  amount  of  field  validation  exists.  Although  efforts 
to  model  search  performance  have  existed  since  Koopman’s  efforts115  during 
World  War  II,  visual  search  prediction  still  is  considered  to  be  in  its  infancy, 
and  no  generally  accepted  overall  model  of  visual  search  yet  exists. 

Despite  the  lack  of  maturity  of  models  of  visual  search,  their  careful  use 
can  still  provide  valuable  insight.  The  search  models  put  more  weight  on  factors 
such  as  EO  system  FOV,  FOR,  and  gimbal  panning  capability  than  do  static 
performance  models.  Such  considerations  often  turn  out  to  be  the  major  cost 
drivers  of  an  EO  system. 

Search  is  a  complex  process  and  the  modeling  of  search  is  very  difficult.  In 
principle,  the  models  must  include  many  factors,  either  implicitly  or  explicitly. 
For  instance,  in  performing  a  physical  search  it  is  important  to  have  a  clear 
line  of  sight  to  the  target.  However,  the  target  could  be  obscured  by  terrain, 
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smoke,  or  defilade,  and  in  some  more  complex  models,  estimates  of  the  prob¬ 
ability  of  occurrence  of  each  of  these  conditions  would  be  an  input  to  the  model. 

The  search  process  has  been  described  using  several  different  mathematical 
formulations.111  Although  it  is  known  that  the  human  searches  through  a 
displayed  image  spending  more  time  on  areas  of  high  information  content 
where  he  or  she  knows  a  target  is  more  likely  to  be,  it  often  is  assumed  that 
the  scan  path  that  connects  a  fixation  sequence  is  random.  The  random  sam¬ 
pling  of  the  image  can  be  assumed  to  proceed  with  or  without  memory,  that 
is,  whether  or  not  the  same  spot  in  an  image  can  be  interrogated  more  than 
once.  The  time  between  fixations  can  be  chosen  to  vary  or  remain  fixed. 

Many  models  make  assumptions  of  how  to  calculate  the  probability  of  de¬ 
tecting  a  target  given  that  a  fixation  lands  on  or  near  a  target.  Based  on 
empirical  results,  Lamar114  formulated  a  relation  between  threshold  contrast 
and  visual  angle  of  the  target  from  the  fovea  called  the  visual  lobe.  It  is  "a  set 
of  probability  contours,  mapping  out  the  probability  of  detecting  the  target  at 
various  eccentricities  from  the  point  of  fixation.”111  The  lobe  can  incorporate 
many  factors  that  would  influence  a  single  glimpse  detection  probability  such 
as  peripheral  visual  acuity  and  display  characteristics. 

Several  search  models  have  been  formulated  that  incorporate  different  as¬ 
sumptions  and  hypothetical  constructs.  Reference  6  provides  an  excellent  sur¬ 
vey  of  many.  In  this  chapter,  we  do  not  explore  the  more  complex  of  these 
models.  Instead,  we  present  a  simpler  model  in  more  detail.  The  model  was 
developed  at  the  Night  Vision  and  Electronic  Sensors  Directorate  (NVESD) 
and  is  presently  the  most  commonly  used  search  model  for  military  applications. 


The  NVESD  Search  Model.  As  an  example  of  a  search  model  that  predicts 
both  physical  and  display  search,  the  main  features  of  the  NVESD  search 
model1  ^  are  presented.  The  model  predicts  the  ensemble  probability  of  locating 
a  single  target  in  a  search  field  using  an  EO  imager.  Most  of  the  field  tests 
that  serve  as  validation  for  the  model  employed  thermal  imagers  searching 
for  ground  targets.  The  model  is  used  widely  within  the  U.S.  Army  community 
as  an  important  component  of  wargames.  It  is  used  by  other  countries  as  well. 
Parameters  used  in  the  search  model  are  calculated  using  results  of  the  static 
performance  model  discussed  previously. 


Display  Search.  For  this  submodel  it  is  assumed  that  an  observer  is  viewing 
the  display  of  an  EO  imaging  system  with  a  fixed  LOS.  The  visual  search 
process  is  assumed  to  proceed  as  a  series  of  random,  independent  glimpses, 
each  glimpse  being  characterized  by  a  probability  of  detection.  For  each  com¬ 
bination  of  observer,  target,  and  background,  a  conditional  probability  is  as¬ 
sumed  that  the  observer  will  acquire  the  target  given  the  target  has  not  been 
found  previously  and  given  that  the  target  will  eventually  be  found.  For  Pi 
equal  to  the  probability  of  finding  the  target  in  the  V th  fixation,  the  conditional 
probability  of  acquiring  the  target  in  j  fixations  is  given  by 

p(j)  =  i  -  f\ a  -  . 

i= 1 


(2.31) 
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If  Pi  is  not  a  function  of  i  (Pi  =  P)  and  P  is  small,  j  can  be  approximated  by 
t/tf  where  tf  is  the  mean  fixation  time  (  —  0.3  s),  and  then 

P(j)  =  Pit)  =  1  -  (1  -  P)t/tf  =  1  -  exp i-Ptltf)  (2  32) 

Pit)  =  1  -  exp(-^TFov)  , 

where  tfov  ( =  tf/P)  is  the  mean  acquisition  time  given  that  the  target  is  found. 
This  is  the  formula  for  the  cumulative  probability  of  the  first  arrival  time  for 
a  Poisson  process  and  is  a  standard  search  equation  seen  throughout  the 
literature.116 

For  an  ensemble  of  observers  the  equation  is 


Pit)  =  Poofl  -  exp(  - £/tfov)]  . 


(2.33) 


Here  the  single  glimpse  probability  of  finding  a  particular  target  has  been 
assumed  to  be  either  zero  or  some  value  Pq  for  every  member  of  the  ensemble, 
and  tfov  =  tf/Po.  The  asymptotic  probability  Poo  is  the  portion  of  observers  in 
the  ensemble  that  can  find  the  target  given  unlimited  time.  It  is  a  measure  of 
the  difficulty  of  acquiring  a  target,  given  it  is  in  the  FOV.  Probability  Poo  arises 
due  to  the  experimentally  observed  fact  that  not  all  observers  in  an  ensemble 
will  always  be  able  to  find  the  target  given  sufficient  time.  It  differs  from  Pd 
for  discrimination  detection  in  that  Poo  involves  trying  to  locate  the  target, 
whereas  in  static  detection  it  is  assumed  that  the  position  of  the  target  is 
approximately  known.  The  Pit)  is  interpreted  as  the  portion  of  the  ensemble 
of  observers  that  can  find  the  target  in  time  t.  See  Fig.  2.28  for  plots  of  Pit) 
for  different  tfov  and  Poo. 

The  equation  for  Poo  is  very  similar  to  the  equation  for  static  detection 
probability,  differing  only  in  the  iVso  values  used: 


1  +  [MN50)d]e  ’ 


(2.34) 


where,  as  before,  N  is  the  number  of  resolvable  cycles  across  the  target,  E  is 
2.7  +  0.7  [N/iNsobl  and  now  (iVso)#  is  the  number  of  cycles  required  for  50% 
acquisition  probability. 

Recall  that  for  static  performance  prediction,  N50  reflects  the  difficulty  of 
performing  static  discrimination  tasks  where  the  approximate  location  of  the 
target  is  known.  But  iN^D  reflects  the  difficulty  of  finding  a  target  in  various 
levels  of  clutter.  The  determination  of  the  appropriate  (A^oId  for  a  particular 
search  scenario  is  made  using  only  an  approximate  set  of  guidelines.  Repre¬ 
sentative  values  of  (Afeo)#  are  shown  in  Table  2.5.  Note  that  these  values  of 
iN5o)D  are  appropriate  for  use  with  the  1-D  static  performance  model  described 
earlier.  As  mentioned  previously,  the  N50  values  appropriate  to  the  2-D  model 
were  0.75  times  those  for  the  1-D  case.  This  factor  also  should  be  applied  to 
the  iNso)D  values  quoted  above  if  the  2-D  static  performance  model  is  used  to 
provide  input  to  this  search  model. 

After  analysis  of  field  test  results,  the  single  glimpse  probability  of  search 
detection,  Pq,  was  proportional  to  Poo.  This  seems  intuitive  since  one  would 
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Fig.  2.28  Search  detection  probability  as  a  function  of  time  for  different  tfov  and  P*. 


expect  the  single  glimpse  probability  of  locating  the  target  to  be  larger  for 
those  easier  search  tasks  in  which  a  higher  portion  of  the  observers  was  able 
to  find  the  target.  The  approximation  that  is  used  for  the  case  of  Poo  0.90 
and  low  to  medium  clutter  is  that 


1  _  P  0  _  Poo 

tFOV  ty  3.4 


(2.35) 


For  N/(Nso)d  <  2,  Poo  can  be  approximated  by  N/2(Ngo)d,  and  substitution 
into  the  equation  above  gives 


1  =  Po  =  1  N 

Tpov  ty  (^5o)d 


(2.36) 


Table  2.5  Approximate  Number  of  Cycles  Required  to  Perform  Target  Acquisition, 
(Nbo)d9  in  Various  Levels  of  Clutter 


Task 

Example 

(N50)d 

Highly  conspicuous  target 

Bright  source,  movement,  zero  clutter 

«0.5 

Low  clutter 

Target  in  field,  on  road 

0.5 

Medium  clutter 

Tank  in  a  desert  of  tank-size  bushes 

1.0 

High  clutter 

Vehicle  in  array  of  similar  vehicles 

2.0 
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Using  these  assumptions,  one  can  evaluate  tfov  using  Eq.  (2.35)  or  (2.36)  for 
use  in  Eq.  (2.33)  for  FOV  search  above. 

The  steps  involved  in  the  calculation  of  the  ensemble  probability  of  FOV 
search  performance  for  a  particular  time  t  are  summarized  as  follows: 

1.  Calculate  N,  the  number  of  resolvable  cycles  across  the  target  critical 
dimension,  using  the  procedure  described  in  Sec.  2.5.2  on  static  per¬ 
formance  modeling. 

2.  Estimate  a  value  for  (Nso)d,  the  number  of  resolvable  cycles  across 
the  target  critical  dimension  required  for  50%  of  the  observer  popu¬ 
lation  to  acquire  the  target  using  guidance  from  Table  2.5. 

3.  Using  the  equation 


[NWmtef 
1  +  [N/(NS0)d]e  ’ 


(2.37) 


determine  the  asymptotic  search  probability  Poo. 

4.  Determine  tfov  using 


Po  _  1 
tf  tfov 


Poo 

3.4 

1  N 
6.8  (iVsob  ’ 


for  Poo  <  0.9 
for  Poo  >  0.9 


(2.38) 


5.  Calculate  the  ensemble  acquisition  probability  at  time  t  using 


P(t)  —  Poo[l  exp(  -  £/tFOv)]  . 


(2.39) 


Though  the  form  of  this  model  is  very  simple,  its  predictions  have  been  shown 
to  agree  with  existing  field  test  results.112  Indeed,  the  model’s  simplicity  is 
one  of  its  major  strengths.  However,  there  are  some  significant  limitations  to 
the  model,  some  of  which  could  benefit  from  further  lab  and  field  testing.  The 
FOV  is  not  an  explicit  parameter  in  the  search  performance  equations  although 
perhaps  it  should  be.  It  is,  however,  a  parameter  required  to  calculate  the 
number  of  resolvable  cycles  across  target.  Efforts  have  been  made  to  extend 
the  procedure  to  the  multitarget  scenario,117  to  multiple  observers  and  dynamic 
scenarios,118  and  to  cued  detection.119  In  its  present  form  the  model  is  not 
applicable  to  search  with  the  unaided  eye,  or  even  with  optically  aided  eyes 
(using  binoculars,  for  example).  Ideally,  the  relation  between  search  perfor¬ 
mance  and  the  amount  of  clutter  should  be  quantified  explicitly  and  should 
be  backed  by  extensive  testing.  Other  important  areas  of  future  research  also 
remain,  for  example,  search  prediction  for  moving  targets  and  target  groupings. 


Physical  Search.  An  equation  similar  to  the  one  used  for  FOV  search  is  used 
to  predict  the  ensemble  probability  of  target  acquisition  as  a  function  of  time 
for  the  case  of  an  observer  systematically  panning  a  thermal  imager  FOV 
through  the  search  field.  The  equation  expressing  the  probability  of  acquiring 
the  target  while  performing  FOR  search  is 
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P(t)  =  P41  -  exp(-</«TFOV)]  ,  (2.40) 

where  n  is  the  number  of  device  FOVs  in  the  search  FOR.  This  equation  is 
applicable  for  the  case  where  the  target  is  not  found  quickly. 

Reference  112  describes  a  slightly  more  complicated  method  of  calculating 
physical  search  probability  as  a  function  of  time.  It  involves  the  calculation 
of  the  probability  of  detecting  the  target  in  an  integer  number  of  scans  through 
the  FOR.  If  one  desires  a  prediction  for  a  noninteger  number  of  scans,  it  is 
assumed  that  the  detection  probability  can  be  linearly  interpolated  from  the 
two  adjacent  probabilities,  which  correspond  to  integer  numbers  of  scans. 

The  procedure  for  calculating  the  probability  of  performing  FOR  search 
detection  is  very  simple  and  is  summarized  as  follows: 

1.  Determine  and  tfov  as  in  the  FOV  search  procedure  described  in 
the  previous  section. 

2.  Calculate  the  number  of  device  FOVs  required  to  cover  the  FOR  using 

FOR 

FOV  " 
and  substitute  into 

P(t)  =  Pootl  -  exp(  -  £/tztfov)]  , 

which  is  the  equation  for  the  ensemble  probability  of  finding  the  target. 

As  for  the  FOV  search  case  this  is  a  relatively  simple  equation  that  describes 
the  FOR  search  performance  for  the  case  of  systematic  panning  of  the  FOR. 

Example.  For  the  purposes  of  this  example,  we  will  assume  that  a  medium 
clutter  level  exists.  (Refer  back  to  Sec.  2.5.1  for  a  description  of  the  example 
system.)  For  a  target  with  an  inherent  AT  of  1.25°C,  at  6  km  the  averaged 
transmission  of  the  "good”  atmosphere  is  51%  leading  to  an  apparent  AT  of 
0.64°C.  From  the  MRT  the  maximum  resolvable  spatial  frequency  correspond¬ 
ing  to  the  apparent  AT  is  4.8  cycles/mrad.  The  number  of  resolvable  cycles 
across  the  target  is  then  2.56  cycles.  For  medium  clutter  the  ( iVsob  value, 
from  Table  2.5,  is  1.  The  resulting  Po c  value  is  0.99,  and  tFOv  is  2.65  s. 

The  "poor”  atmosphere  results  in  an  apparent  temperature  difference  of 
0.093°C,  a  maximum  resolvable  frequency  of  2.51  cycles/mrad,  and  1.34  cycles 
across  the  critical  dimension  of  the  target.  The  Poo  for  this  case  is  0.74,  and 
tFov  is  4.52  s.  Probability  of  display  search  detection  versus  time  is  plotted 
for  both  atmospheres  in  Fig.  2.29. 

Assuming  the  search  field  is  12  deg2  (=  5  x  FOV),  and  using  the  equation 
above  for  an  FOR  search,  the  probability  of  FOR  search  versus  time  is  cal¬ 
culated.  Figure  2.30  shows  the  FOR  search  probability  versus  time  for  both 
atmospheres. 
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3.1  INTRODUCTION 

The  quality  of  optical  systems  depends  on  the  performance  of  individual  sur¬ 
faces,  the  surfaces  of  optical  elements  (windows,  prisms,  lenses,  and  mirrors), 
and  detectors.  Optomechanical  design  is  concerned  with  maintaining  the  cor¬ 
rect  position  and  shape  of  these  surfaces.  Optomechanics  is  different  from 
conventional  mechanical  engineering  due  to  its  emphasis  on  strain  rather  than 
stress.  In  optomechanics,  very  small  strains,  typically  about  a  part  per  million, 
are  important.  This  chapter  is  intended  to  address  the  most  common  opto¬ 
mechanical  problems  encountered  in  IR  systems.  The  development  is  from 
simple  components  to  more  complex  systems  analysis. 


3.2  WINDOWS 

As  zero-power  elements,  windows  are  the  simplest  components  of  an  optical 
system.  Windows  are  intended  to  provide  protection  for  the  optical  system 
while  it  is  being  subjected  to  a  wide  variety  of  environmental  loading  condi¬ 
tions.  This  variety  of  loading  conditions  complicates  the  design  of  these  "sim¬ 
ple”  elements. 

3.2.1  Thermal  Effects  on  Flat  Windows 

A  window  exposed  to  thermal  gradients  deforms  from  a  stress-free  condition. 
Thermal  deformation  of  the  window  can  induce  an  error  in  the  wave  front 
passing  through  the  window.  For  axial  and  radial  thermal  gradients,  approx¬ 
imations  are  used  to  estimate  the  magnitude  of  the  wave-front  error  induced. 
As  a  rule  of  thumb,  the  window  must  be  as  thin  as  possible,  and  as  oversized 
with  respect  to  the  clear  aperture  as  reasonable,  to  minimize  thermal  gradient 
effects.  Insulating  the  edge  of  the  window  reduces  radial  gradient  effects.  Use 
of  active  temperature  control  of  the  window  edge  may  be  necessary  in  some  cases. 

Axial  Temperature  Gradients.  A  linear  temperature  gradient  through  the 
thickness  of  a  window  causes  the  window  to  deform  into  a  spherical  shape.  If 
the  window  is  initially  a  plane  parallel  plate  with  unconstrained  edges,  the 
radius  of  the  curvature  of  the  thermal-gradient-induced  spherical  shape  is 
given  by: 

R  =  —  ,  (3.1) 

aq 

where 

R  =  thermally  induced  radius  of  curvature 
a  =  thermal  coefficient  of  expansion  of  the  window  material 
q  -  heat  flux  per  unit  area  absorbed  by  the  window 
K  -  thermal  conductivity  of  the  window  material. 

The  ratio  of  thermal  coefficient  of  expansion  to  thermal  conductivity  is  a  ma¬ 
terial  parameter  called  the  thermal  distortion  parameter ,  and  is  given  in  units 
of  meters  per  watt.  For  minimum  thermal-gradient-induced  distortion,  the 
thermal  distortion  parameter  should  be  as  small  as  possible. 
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After  distortion  into  a  spherical  shape,  a  circular  window  acts  as  a  weak 
meniscus  lens.  The  power  of  this  meniscus  lens  is  given  by1: 


(3.2) 


where 

1  If  =  power  of  the  distorted  window  (reciprocal  of  the  focal  length) 
n  =  index  of  refraction  of  the  window  material 
a  IK  =  window  material  thermal  distortion  parameter 
h  =  window  thickness. 

Radial  Temperature  Gradients.  A  linear  radial  temperature  gradient  from 
center  to  edge  of  a  circular  window  induces  a  change  in  optical  pathlength  for 
a  wave  front  passing  through  the  window.  Assume  that  the  window  has  no 
edge  loading  (simple  support)  and  that  the  value  of  the  thermo-optic  coefficient 
(variation  in  window  index  of  refraction  with  temperature)  is  constant  for  small 
temperature  gradients.  Then,  if  second-order  terms  are  neglected,  the  optical 
path  difference  is  estimated  by1: 


OPD  = 


( n  -  1)(1  +  v)a  + 


hkT  , 


(3.3) 


where 

OPD  =  optical  path  difference  induced  in  the  wave  front 
v  =  Poisson’s  ratio  for  the  window  material 
dnldT  =  thermo-optic  coefficient 

A  T  =  temperature  gradient  from  center  to  edge  in  the  window. 


3.2.2  Pressure  Effects  on  Flat  Windows 

Pressure  differentials  induce  deflection  in  an  initially  flat  window.  Deflection 
due  to  pressure  in  the  window  causes  a  change  in  the  optical  pathlength  in 
the  wave  front  passing  through  the  window.  Stress  is  induced  in  the  window 
by  the  pressure  differential.  Generally,  stress  in  the  window  due  to  the  pressure 
differential  is  a  more  serious  concern  in  the  performance  of  IR  systems  than 
the  optical  path  difference. 

Pressure-Induced  Window  Deformation.  The  maximum  optical  path  differ¬ 
ence  for  a  wave  front  passing  through  a  circular  window  at  normal  incidence, 
when  the  window  is  deformed  by  a  pressure  differential,  is  given  by2: 


OPD 


-  8.89  x  10~3 


(n  -  1)A P2d6 
E2h 5 


(3.4) 


where 

OPD  =  maximum  optical  path  difference  due  to  the  pressure 
differential 
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A P  =  axial  pressure  differential  in  the  window 
d  =  window  diameter 

E  =  elastic  modulus  of  the  window  material. 


Window  Stress  Due  to  Pressure  Differentials.  For  brittle  IR  materials,  the 
maximum  tensile  stress  due  to  a  pressure  differential  should  not  exceed 


(Tmax  =  ,  (3.5) 

where 

Umax  =  maximum  allowable  tensile  stress 
up  =  fracture  stress  of  the  window  material 
SF  =  safety  factor. 

A  common  practice  in  optomechanical  engineering  is  to  use  a  safety  factor  of 
4.  An  increase  in  effective  inertia  loading  by  a  factor  of  2  is  used  to  allow  for 
suddenly  applied  loading,  and  another  safety  factor  of  2  is  used  for  stress 
concentration  effects  near  the  window  edge. 

For  a  simply  supported  circular  window,  the  minimum  ratio  of  window 
thickness  to  diameter,  or  aspect  ratio,  is  given  by: 


h  =  2 \_ 3 AP(3  -f  vjSF J  ’  (3'6) 

where  dlh  is  the  window  aspect  ratio  and  vf  is  the  maximum  allowable  tensile 
stress. 

For  a  clamped  circular  window,  the  minimum  aspect  ratio  is  given  by: 


d  _ 

h  ~  [  3AP(1  +  v)SF 


(3.7) 


The  normal  conservative  design  practice  is  to  assume  a  simply  supported  win¬ 
dow.  This  assumption  should  be  used  for  both  circular  and  rectangular  windows. 

For  a  rectangular  window,  the  stress  equation  is  used  to  find  the  minimum 
thickness  necessary  to  withstand  a  given  external  pressure.  If  the  window  is 
simply  supported,  the  minimum  thickness  is  given  by: 


H.  - 2__r, 

4[1  +  2(6/L)3]J 

where 

h  -  minimum  window  thickness 
b  =  unsupported  window  width 
L  =  unsupported  window  length. 
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If  the  window  is  clamped,  the  minimum  thickness  is  given  by: 

,  =  Jap  i  YA 

1 2[1  +  (6/L)4]j 


3.2.3  Dome  Stress  Due  to  Pressure  Differentials 

Use  of  a  dome  streamlines  the  window  and  permits  a  very  wide  field  of  view. 
For  design,  dome  deformation  is  normally  not  considered  as  important  as  the 
strength  of  the  dome.  Normally,  dome  stress  at  any  radius  is  evaluated  using 
the  Lame  pressure  vessel  equations  given  by3: 


or  rn  =  Vh  =  -AP 


R30(Ri  +  2  R3) 
2 R3(R3  -  Rf) 


CJ>  =  -AP 


R3o(R3  -  Rf) 
R3(R3  -Rf) 


(3.10) 

(3.11) 


where 

dm  =  meridional  membrane  stress 
dh  =  hoop  membrane  stress 
dr  =  radial  wall  stress 
AP  =  external  pressure 
R0  =  outer  radius  of  the  dome 
Ri  =  inner  radius  of  the  dome 
R  =  radius  of  the  dome. 

If  the  included  angle  of  the  dome  exceeds  180  deg  (hyper-hemisphere),  as  a 
rule  of  thumb  assume  that  the  meridional  membrane  stress  is  100%  greater 
than  the  hoop  membrane  stress.  Dome  geometry  is  shown  in  Fig.  3.1. 

If  the  ratio  of  the  dome  radius  to  thickness  is  10  or  more,  then  the  dome  is 
said  to  be  thin.  For  thin  domes,  a  simplified  set  of  equations  is  used  to  determine 
stresses.  For  an  externally  pressurized  dome  these  stresses  are  given  by: 


O'm  — 


1 

1  +  cose)) 


(3.12) 


<Jh 


1  +  cos<|> 


(3.13) 


where  h  is  the  dome  thickness  and  $  is  the  angle  from  the  vertex  of  the  dome. 

Both  the  Lame  equations  and  the  simplified  equations  hold  for  a  self- weight 
loaded  dome.  A  dome  exposed  to  high-acceleration  loading  can  be  tested  using 
external  pressure  to  produce  an  equivalent  stress  condition  in  the  dome  ma¬ 
terial.  In  the  preceding  equations,  the  external  pressure  is  replaced  by  an 
equivalent  external  pressure  found  using  the  following  equation: 


OPTOMECHANICAL  SYSTEM  DESIGN  1 27 


Spherical  Sector  Hemisphere  Hyper  Hemisphere 

Fig.  3.1  Dome  geometry. 


AP  =  -ph  ,  (3.14) 

8 

where 

A P  =  equivalent  external  pressure 
g  -  acceleration  due  to  the  Earth’s  gravity 
a  =  acceleration 
p  =  dome  material  density. 


A  dome  under  external  pressure  may  fail  through  collapse  by  elastic  buck¬ 
ling.  Elastic  buckling  of  domes  is  a  complex  problem  that  lacks  a  simple  the¬ 
oretical  solution.  The  following  equation  was  developed  from  extensive  model 
testing: 


PCR 


0.8 E  (Ro  -  RiX 

(1-V2M  Ro  ) 


(3.15) 


where 

-Pcr  =  critical  collapse  pressure 
E  =  elastic  modulus  of  the  dome  material 
v  =  Poisson’s  ratio  for  the  dome  material. 

If  the  dome  loading  is  uniform  on  the  projected  area  (aerodynamic  loading), 
the  stresses  in  a  thin  dome  are  estimated  by: 
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Clamp  Screw— Nylon 

Clamp  Ring— Delrin 

Dome 


Dome  Seal— Neoprene 


32  RMS  Surface  Finish  on  Seat  Match  Angles 
to  +/-  IT  Center  of  Curvature  to  Window  and 
Apex  of  Seat  Should  Match  to  0.001  R0. 


Fig.  3.2  Typical  hermetically  sealed  dome  mount. 


_  p(r\ 

°m  ~  2\h) 


(3.16) 


Vh 


p(r\ 
2  \h) 


cos(2<|>)  , 


(3.17) 


where  P  is  the  magnitude  of  the  uniform  loading  on  the  projected  area  of 
the  dome. 

Domes  are  typically  mounted  in  a  conical  seat.  To  avoid  collapse  by  elastic 
buckling  under  the  loading  of  external  pressure,  the  apex  of  the  conical  seat 
and  the  center  of  curvature  of  the  dome  must  be  coincident  to  a  tolerance  of 
0.001  R0 •  For  minimum  stress  in  the  area  of  the  seat,  the  angle  of  the  seat 
must  match  the  angle  of  the  dome  edge  to  a  tolerance  of  ±  1  arcmin.  In  addition, 
the  dome  seat  should  have  a  surface  finish  of  32  rms  or  better.4  A  surrounding 
external  ring  with  a  conical  inner  edge  tangential  to  the  outer  surface  of  the 
dome  is  used  to  retain  the  dome  in  its  seat.  If  a  gasket  is  required  to  seal  the 
dome,  the  gasket  is  placed  in  the  conical  surface  of  the  seat.  Use  of  a  compliant 
bezel  material,  such  as  nylon  or  delrin,  reduces  stress  in  the  dome  and  allows 
relative  motion  of  the  dome  with  respect  to  the  seat  during  temperature  changes. 
A  typical  dome  mounting  is  shown  in  Fig.  3.2. 

A  hemispheric  dome  may  be  mounted  against  a  flat  seat  with  a  surrounding 
bezel.  Typically,  the  area  between  the  bezel  and  the  dome  is  filled  with  an 
adhesive  to  restrain  the  dome.  A  zinc  sulfide  dome  2.4  mm  thick,  with  an 
external  radius  of  about  50  mm,  mounted  in  this  fashion  is  used  to  protect  an 
IR  seeker  in  the  nose  of  a  homing  107-mm  mortar  shell.  During  firing,5  this 
dome  sees  an  acceleration  of  11  x  103  g,  and  survives  a  stress  of  26  MPa. 


3.2.4  Window  Strength 

Most  optical  window  materials  are  brittle,  and  fail  by  fracture.  Failure  occurs 
as  a  result  of  the  enlargement  of  small  surface  flaws  under  tensile  stress;  these 
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flaws  become  cracks  that  propagate  across  the  surface  until  catastrophic  frac¬ 
ture  occurs.  No  significant  plastic  range  of  deformation  occurs  before  failure 
in  window  materials.  Failure  is  entirely  due  to  surface  fracture.  Window  strength 
is  therefore  dependent  on  surface  condition  and  surface  area.  The  larger  the 
flaw  in  the  window  surface,  the  lower  the  strength.  A  larger  window  will  have 
a  greater  chance  of  having  a  larger  flaw,  and  is  usually  weaker  than  a  smaller 
area  window. 

Nondestructive  testing  techniques  normally  cannot  be  used  to  locate  the 
largest  flaw  in  the  surface  of  the  window.  Window  strength  is  determined  by 
scaling  from  tests  of  small  samples.  Because  uncertainty  exists  concerning  the 
actual  window  surface  condition,  the  strength  of  the  window  is  given  in  terms 
of  probability  of  failure. 

Two  probability  distributions  are  used  to  determine  the  strength  of  a  win¬ 
dow:  the  Gaussian  (normal)  and  Weibull.  For  the  range  of  strength  of  interest 
in  optical  windows,  both  distributions  are  a  good  representation  of  window 
strength.6  The  probability  of  failure  of  a  window  at  an  applied  stress  is  given 
by  the  Gaussian  distribution: 


Pf 


(3.18) 


where 

Pf  =  probability  of  failure 

<ja  -  applied  stress 

cf  =  mean  stress  of  the  distribution 

dd  =  standard  deviation  of  the  distribution. 

The  probability  of  failure  of  a  window  at  an  applied  stress  is  given  by  the 
Weibull  distribution: 


Pf  —  1  -  exp 


(3.19) 


where  m  is  the  Weibull  modulus  and  cro  is  the  scale  factor. 

Both  of  these  failure  probability  equations  must  be  scaled  to  the  actual 
surface  area  and  the  surface  condition  of  the  window.  If  the  stress  for  failure 
is  known  for  a  certain  surface  area,  then  the  stress  required  for  failure  for 
another  surface  area  is  found  by7: 


<n 


(3.20) 


where  Si,  S2  are  the  respective  surface  areas  and  01,  0-2  are  the  respective 
stresses.  If  the  stress  required  for  failure  is  known  for  a  certain  flaw  depth, 
then  the  stress  required  for  failure  at  another  flaw  depth  is  given  by8: 
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where  ai,  a2  are  the  respective  flaw  depths. 

Tables  3.1  and  3.2  provide  representative  Gaussian  and  Weibull  statistics 
for  common  window  materials.  Unfortunately,  scaling  data  on  surface  area 
and  flaw  size  are  not  common  in  a  technical  discussion  of  window  strength. 


Table  3.1  Gaussian  Strength  Properties  of  Glass 


Material  Type 

(MPa) 

(MPa) 

(MPa) 

*JV0.5 

(s) 

s 

(mm2) 

a 

(^m) 

1.  Fused  silica  (Amersil) 

5.52 

103 

43.7  x  103 

471 

5 

2.  Borosilicate  (GE  FN  7052) 

100 

32.3 

471 

6 

3a.  Borosilicate  (Pyrex) 

(Corning  7740) 

61.4 

245 

251 

660 

Unabraded 

3b.  Borosilicate  (Pyrex) 

(Corning  7740) 

236.7 

56.6 

660 

2 

4.  Silicon 

137.0 

32.4 

2 

Table  references  by  material  type: 

1,  2  J.  E.  Burke,  R.  H.  Doremus,  W.  B.  Hillig,  and  A.  M.  Turkalo,  "Static  fatigue  in  glasses 
and  alumina,’'  in  Ceramics  in  Severe  Environments,  W.  W.  Krigel  and  H.  Palmour,  Eds., 
Plenum  Press,  New  York  (1971). 

3a,  3b  R.  H.  Doremus,  "Fracture  and  fatigue  of  glass,”  Treatise  on  Materials  Science  and  Tech¬ 
nology,  Vol.  22,  Academic  Press,  New  York  (1982). 

4  F.  M.  Anthony  and  A.  K.  Hopkins,  "Actively  cooled  silicon  mirrors,”  Proceedings  of  the 
SPIE  297,  196-203  (1981). 


Table  3.2  Weibull  Strength  Properties  of  Glasses 


ao 

s 

a 

‘r 

Material  Type 

m 

(MPa) 

(mm2) 

(p.m) 

(MPa) 

(s) 

Pf 

n 

1. 

Schott  Zerodur 

14 

11.3 

50 

10 

90 

10'3 

2a. 

ULE  (Corning  7971) 

4.5 

40.4 

Polished 

15.8 

60 

29.2 

2b.  ULE  (Corning  7971) 

6.8 

11.6 

Unpolished 

11.7 

60 

Hr3 

15.1 

3. 

Silicon  (single  crystal) 

4.54 

346.5 

4. 

AL2O3  (single  crystal) 

5-15 

30-50 

5. 

CaF2 

3 

5 

6. 

SrF2 

3 

4 

7. 

ZnSe 

6-9 

23-27 

8. 

ZnS 

4-9 

15-29 

9. 

Soda  lime  (Kimble  R-6) 

6.18 

128.8 

660 

2 

16.0 

10. 

Pyrex  (Corning  7740) 

4.99 

257.2 

660 

2 

27.4 

Table  references  by  material  type: 

1  Zerodur  Glass  Ceramics,  Schott  Optical  Glass,  Duryea,  PA  (1982). 

2a  2b  D.  C.  Cranmer,  "Mechanical  properties  of  fused  silica,”  The  National  Bureau  of  Standards 
(now  The  National  Institute  of  Standards  and  Technology),  U.S.  Department  of  Commerce 
(1987). 

3  C.  P.  Chen  and  M.  H.  Leipold,  "Stress  rate  and  proof  testing  of  silicon  wafers,”  Journal  of 
the  American  Ceramic  Society  68,  C54-C55  (1985). 

4-8  N.  C.  Fernelius,  G.  A.  Graves,  and  W.  L.  Knecht,  "Characterization  of  candidate  laser 
window  materials,”  Proceedings  of  the  SPIE  297,  188-195  (1981). 

9,  10  R.  H.  Doremus,  "Fracture  statistics:  a  comparison  of  the  normal,  Weibull,  and  type  1 
extreme  value  distributions,”  Journal  of  Applied  Physics  54,  193-198  (1983). 
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A  window  that  is  safe,  as  determined  by  a  probability  of  failure  calculation 
as  shown  previously,  may  still  fail  under  long-term  loading  due  to  static  fa¬ 
tigue.  In  the  presence  of  a  corrosive  environment,  and  under  constant  tensile 
loading,  surface  flaws  may  propagate  slowly  into  catastrophic  cracks.  If  the 
size  of  the  largest  or  critical  surface  flaw  is  known,  and  the  tensile  stress 
applied  to  this  flaw  is  also  known,  the  time  to  failure  can  be  estimated.  Un¬ 
fortunately,  nondestructive  testing  for  surface  flaws  is  usually  not  practical 
for  windows.  Instead,  windows  are  proof  tested  by  subjecting  the  window  to  a 
higher  stress  than  the  design  stress.  If  the  window  does  not  fail  during  the 
proof  test,  the  test  establishes  an  upper  limit  for  the  critical  flaw,  which  can 
in  turn  be  used  to  estimate  the  time  to  failure. 

Velocity  of  crack  propagation  is  related  to  the  stress  intensity  in  the  window. 
If  the  crack  velocity  is  related  to  stress  intensity  by  a  power  law,9 

V  =  AKi  ,  (3.22) 


then  the  time  to  failure  after  proof  testing  is  given  by10: 

2Kjcn  (°p 
F  (r^AY^in  -  2)  V<ra 

where 

V  —  crack  velocity 

A  =  a  material  parameter 

n  —  a  material  parameter 

Ki  =  stress  intensity 

tp  =  time  to  failure  after  proof  testing 
Kic  —  critical  stress  intensity  for  the  material 
<ja  =  service  tensile  stress 
(Tp  -  proof  tensile  stress 

Y  =  a  constant,  normally  set  equal  to  Vtt. 


(3.23) 


If  the  crack  velocity  is  related  to  the  stress  intensity  by  an  exponential  law, 


li 


V  =  exp  ~(a/6)  exp(Kilb)  , 


(3.24) 


tp 


2  b2  exp  {alb)  \Kic  ( , 

i 

$ 

Q 

l  h  LJ  +  *J 

exp 

_  WJ 

(3.25) 


where  a  is  a  material  parameter  and  b  is  a  material  parameter. 

Table  3.3  provides  static  fatigue  material  parameters  for  a  variety  of  window 
materials.  Unlike  strength  calculations  based  on  probability  distributions, 
static  fatigue  material  parameters  are  independent  of  surface  area  and  surface 
condition. 

Vibration  of  a  window  can  induce  static  fatigue.  The  service  lifetime  of  a 
window  exposed  to  cyclic  loading  is  related  to  the  service  lifetime  under  static 
loading  by12: 
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Table  3.3  Fracture  Mechanics  Properties  of  Glasses 


Kj  =  a  +  blnV 

Kj  =  AKj 

Material  Type 

Kic 

(MN/m3/2) 

a 

(kN/m3/2) 

6 

(kN/m3/2) 

A 

(m/s) 

n 

1.  Fused  silica 

0.741 

693.1 

13.42 

36.1 

2.  96%  silica  (Corning 

7900) 

0.700 

649.0 

13.88 

3.  Vycor  (Corning  7913) 

0.715 

650.7 

12.98 

49-52 

4.  Aluminosilicate 
(Corning  1723) 

0.846 

795.0 

17.97 

46 

5.  Borosilicate  (Pyrex) 

mm 

643.1 

14.14 

16.0 

6.  Dense  flint  (Schott  SF-1) 

EH 

571.7 

15.57 

38 

7.  Borosilicate  crown 
(Schott  BK-7) 

0.862 

794.6  V  >  10-6  m/s 

582.6  V  <  10“ 7  m/s 

25.3 

11.77 

8.  Borosilicate  crown 
(Schott  UBK-7) 

0.886 

787.2  V  >  10" 6  m/s 
597.6  V  <  10’ 7  m/s 

26.74 

13.48 

9.  Soda  lime 

0.750 

831.0 

24.3 

0.0313 

11.65 

10.  Sapphire 

0.300 

1305 

26.9 

11.  ZnSe  (single  crystal) 

0.33 

1.8  x  1018 

40 

12.  ZnSe  (polycrystalline) 

13.  ULE  (Corning  7971) 

0.90 

605 

11.6 

2.0 

40 

Table  references  by  material  type: 

1-8  S.  M.  Wiederhorn,  A.  G.  Evans,  and  D.  E.  Roberts,  "A  fracture  mechanics  study  of  the 
Skylab  windows/’  in  Fracture  Mechanics  of  Ceramics,  R.  C.  Bradt,  D.  P.  H.  Hasselman, 
and  F.  F.  Lange,  Eds.,  Plenum  Press,  New  York  (1974). 

9, 10, 13  W.  P.  Barnes,  Jr.,  Mechanical  Engineering  Aspects  of  Optical  Systems ,  SPIE  Engineering 
Update  Series  Course  U13  Notes,  SPIE,  Bellingham,  WA  (1986). 

11,12  S.  W.  Freiman  et  al.,  "Influence  of  microstructures  on  crack  propagation  in  ZnSe,”  Journal 
_ of  the  American  Ceramic  Society  58,  406-409  (1975). _ 


where 

tc  =  cyclic  time  to  failure 

ts  =  static  time  to  failure 

os  =  failure  stress  under  static  loading 

ot  =  cyclic  mean  stress 

n  =  material  parameter  (from  Table  3.3) 

J~ 1  =  amplitude  factor. 

For  sinusoidal  loading  of  the  window, 


o(t)  =  oc  +  o0  sin(a>£)  . 


The  amplitude  factor  is  given  by: 


J  = 


n\ 

(n  -  2 Mi!)2 


(3.26) 


(3.27) 


(3.28) 
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where 

<J0 

=  cyclic  stress  amplitude 

(0 

=  cyclic  period 

J 

=  amplitude  factor 

(n/2)z 

=  integer  part  of  n/2. 

If  the  cyclic  mean  stress  is  zero,  the  amplitude  factor  is  given  by: 


1  r[(n  +  l)/2] 
(4tt)^  nn/2  +  1) 


(3.29) 


A  useful  approximation  for  the  amplitude  factor  when  the  cyclic  mean  stress 
is  zero  and  the  material  parameter  is  greater  than  nine  (as  it  normally  is  for 
common  window  materials)  is: 


J-1  =  {2i 


1+4^  + 


(3.30) 


where  T  denotes  the  Gamma  function. 

Note  that  the  service  life  of  a  window  under  cyclic  stress  is  longer  than 
under  pure  static  stress.  The  increased  lifetime  results  from  the  window  being 
stressed  in  tension  during  only  part  of  the  cycle. 


3.2.5  Window  Fundamental  Frequency 

Application  of  the  cyclic  fatigue  equations  presented  in  Sec.  3.2.4  requires 
knowledge  of  the  fundamental  frequency  of  the  window.  The  fundamental 
frequency  of  a  simply  supported  circular  window  is  given  by13: 


fn 


=  *  1  T  sEh2 


4r2Ll2p(l-  v2)J 


Vi 


(3.31) 


where 

fn  =  natural  frequency  of  the  window 
g  =  gravitational  acceleration  at  the  earth’s  surface 
E  =  elastic  modulus  of  the  window  material 
h  =  window  thickness 
v  =  Poisson’s  ratio  for  the  window  material 
p  =  window  material  density. 

The  fundamental  frequency  of  a  simply  supported  rectangular  window  is  given  by: 


tt  gEh 2 
2  |_12p(l  -  v2) 


(3.32) 


where  b  is  the  window  width  and  L  is  the  window  length. 
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3.2.6  Window  Mounting 

Because  windows  are  zero-power  optical  elements,  window  position  usually 
does  not  influence  the  optical  performance  of  the  system.  Tilt  and  translation 
are  acceptable  when  mounting  the  window.  It  is  not  uncommon  to  introduce 
a  deliberate  tilt  into  a  window  with  respect  to  the  optical  axis  to  control  ghost 
reflection.  However,  window  deformation  introduces  optical  aberration.  Win¬ 
dow  mounts  must  therefore  be  designed  to  minimize  window  deformation. 

Use  of  a  compliant  adhesive  material  between  the  window  edge  and  mount 
reduces  mounting  deformation.  The  adhesive  bond  is  limited  to  the  edge  of  the 
window  and  restrains  the  window  both  axially  and  radially.  Hard  contact 
occurs  between  the  window  and  mount.  (The  thin  mounting  ring  surrounding 
a  window  is  sometimes  called  a  bezel.)  A  ring  of  flexible  adhesive  between  the 
window  and  mount  reduces  thermal-induced  stress  in  the  window  due  to  ther¬ 
mal  coefficient  of  expansion  mismatch  between  the  window  and  mount.  Any 
irregularity  in  the  surface  of  the  mount  in  contact  with  the  window  induces 
a  corresponding  deformation  in  the  window.  The  optical  effect  on  the  window 
due  to  mount-induced  deformations  is  difficult  to  calculate.  A  rule  of  thumb 
is  to  require  that  the  surface  to  which  the  window  is  mounted  have  no  irreg¬ 
ularity  greater  than  the  elastic  deformation  of  the  window  or  mount  under 
the  window  clamping  stress.  If  no  retainer  is  used  to  hold  the  window  in  place, 
the  clamping  force  is  set  equal  to  the  window  weight  in  calculating  the  surface 
deformation.  The  permissible  tolerance  for  the  mounting  surface  irregularity 
is  given  by: 

P  =  W  +  F  ,  (3.33) 


*  _  Ph 
bt  SE  ’ 

where 

8*  =  irregularity  tolerance  for  the  window  mount 
W  =  window  weight 
h  =  window  thickness 

S  =  area  of  contact  between  mount  and  window 
E  =  window  material  elastic  modulus 
F  =  window  clamping  force. 


(3.34) 


The  required  edge  thickness  of  adhesive  around  the  window  is  determined 
using  the  equations  given  in  Sec.  3.4.2. 

Mechanical  contact  between  the  window  and  mount  is  another  scheme  for 
mounting  windows.  Contact  should  not  be  made  between  the  window  edge  and 
mount  unless  the  window  edge  is  tapered.  Contact  of  the  mount  against  a 
window  edge  that  is  normal  to  the  plane  of  the  window  surface  can  create 
large  hoop  stresses.  These  large  hoop  stresses  arise  from  a  thermal  coefficient 
of  expansion  mismatch  between  window  edge  and  window  mount.  A  temper¬ 
ature  drop  causes  the  window  mount  to  contract  around  the  window  creating 
these  hoop  stresses.  Large  temperature-induced  stresses  in  the  window  are 
reduced  by  tapering  the  edge  of  the  window  and  utilizing  a  matching  taper  in 
the  window  mount.  Use  of  a  tapered  edge  permits  the  window  to  move  relative 
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to  the  mount  as  the  mount  expands  or  contracts.  Reduction  of  contact  stresses 
in  the  window  mount  requires  that  the  taper  angles  of  the  window  and  mount 
be  matched  to  1  arcmin.  In  addition,  a  high-quality  surface  is  necessary  on 
the  window  mount,  typically  an  8  to  32  finish.  Because  the  window  moves 
relative  to  the  mount,  a  flexible  retainer  is  required.  Flexibility  is  provided 
by  milling  a  groove  in  a  conventional  retainer.  The  area  under  the  groove  acts 
as  a  flexure  and  permits  the  retainer  to  move  up  and  down  to  accommodate 
the  motion  of  the  window. 

Isolation  of  the  window  from  expansion  and  contraction  of  the  mount  is 
provided  by  O-ring  seals  between  the  window  and  mount.  O-ring  seals  are 
located  around  the  circumference  on  the  upper  edge  of  the  window,  and  on  the 
lower  edge  of  the  window,  directly  opposed  to  the  upper  edge.  Each  is  com¬ 
pressed  to  about  50  to  70%  of  the  nominal  full  compression.  A  space  is  created 
between  the  window  and  mount  due  to  this  lack  of  compression.  The  remaining 
flexibility  of  the  O-rings  created  by  this  partial  compression  is  used  to  take 
up  the  change  in  clearance  between  window  and  mount  as  the  temperature 
changes.  O-ring  seals  of  up  to  70  durometers  are  used  for  this  application. 

Figure  3.3  shows  details  of  typical  window  mounts. 


Window 


Retainer  Matches  Window 
Mount  Matches  Window 

8  to  32  Finish  Mount  Matches 
Window  Angle  to  +/-1'r 


Window 


(b) 


(c) 


Fig.  3.3  Typical  window  mounts:  (a)  hard  mount,  (b)  athermal  hard  mount,  and  (c)  O-ring 
mount. 
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3.3  PRISMS 

This  section  emphasizes  the  principles  of  mounting  prisms  rather  than  prism 
design. 

3.3.1  General  Principles  of  Prism  Mounting 

The  fundamental  rules  for  mounting  prisms  are  the  same  as  for  any  other 
precision  optical  component.  The  prism  must  be  held  in  a  well-defined  position 
without  deformation.  Unlike  windows,  prisms  are  very  stiff  and  difficult  to 
deform.  An  additional  difference  between  windows  and  prisms  is  the  require¬ 
ment  for  the  precise  location  of  the  prism  with  respect  to  angle.  Since  prisms 
are  zero-power  optical  elements,  precise  location  of  the  prism  with  respect  to 
translation  is  rarely  required. 

In  designing  a  prism  mount,  deformation  of  the  optically  active  prism  faces 
must  be  avoided.  Deformation  can  be  greatly  reduced  if  mounting  surfaces  are 
selected  on  the  sides  of  the  prism  that  are  at  right  angles  to  the  optically  active 
prism  surfaces.  Stray  light  can  enter  a  prism  through  surfaces  that  are  used 
in  total  internal  reflection.  Control  of  stray  light  may  require  an  additional 
opaque  shield  around  the  prism  to  limit  transmission  of  light  into  the  prism. 
In  some  cases,  such  as  Porro  prism  assemblies,  a  shallow  cut  across  the  hy¬ 
potenuse  of  the  prism  is  a  useful  means  of  suppressing  stray  light  at  very 
oblique  angles.  Overconstraint  of  the  prism  should  be  avoided  by  the  use  of 
kinematic  mounting  principles. 


3.3.2  Prism  Bonding 

Prisms,  with  their  high  stiffness  and  large  flat  areas,  are  well  suited  for  direct 
bonding  to  metal  mounts.  The  classic  method  involves  the  use  of  a  large  circular 
bond  against  a  side  of  the  prism  at  right  angles  to  the  optically  active  surface. 
Yoder14  has  developed  an  equation  that  is  used  to  size  the  area  of  the  metal 
to  glass  bond: 


S  = 


aWSF 

> 

cr 


(3.35) 


where 

S  =  bond  area 

a  =  acceleration  of  the  prism  (in  dimensionless  g) 

W  =  prism  weight 

SF  =  a  safety  factor  (Yoder14  suggests  a  safety  factor  of  2) 
cr  =  shear  strength  of  the  adhesive. 

Control  of  the  adhesive  thickness  and  prism  angle  with  respect  to  the  mount 
is  achieved  by  placing  three  symmetrically  located  shims  or  spacers  between 
prism  and  mount  during  the  bonding  operation.  Plastic  or  metal  shims  and 
thin  wires  are  all  possible  choices  for  the  spacers.  Plastic  shims  allow  for  better 
expansion  or  contraction  of  the  prism  with  respect  to  the  mount,  while  metal 
shims  provide  better  angular  stability.  A  semiflexible  adhesive  such  as  3M 
EC-2216®  permits  expansion  or  contraction  of  the  mount  with  respect  to  the 
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Silastic  Potting  Compound 

Holes  for  Injecting  Potting  Compound 


Mount 


Fig.  3.4  Bonded  window  mount. 


prism.  Large  bond  areas  where  the  distance  between  bond  edge  and  center 
exceeds  10  mm  may  require  several  weeks  to  cure  completely.  The  curing  rate 
is  improved  by  breaking  the  large  single  bond  into  a  series  of  smaller  bonds 
of  equivalent  total  area.  Figure  3.4  shows  details  of  a  typical  bonded  window 
mount. 


3.3.3  Kinematic  Mounting  of  Prisms 

Kinematic  mounting  of  prisms  requires  the  selection  of  no  more  than  six  points 
to  locate  the  prism  uniquely  without  overconstraint.15  To  accommodate  changes 
in  temperature,  it  is  desirable  to  use  less  than  the  full  six  kinematic  locating 
points,  so  that  the  prism  is  free  to  expand  or  contract  with  respect  to  the  mount. 
Kinematic  points  should  be  selected  to  maintain  the  angular  position  of  the 
prism.  Locating  angular  defining  kinematic  points  may  require  violation  of 
the  basic  principles  of  prism  mounting  since  in  many  cases  the  ideal  location 
of  these  points  is  in  contact  with  an  optically  active  surface.  If  direct  contact 
between  mounting  points  and  an  optically  active  surface  is  required,  the  flat¬ 
ness  and  coplanarity  of  the  mounting  points  are  given  by  Eqs.  (3.33)  and  (3.34). 

Retention  of  the  prisms  in  a  kinematic  mount  is  provided  by  spring  pre¬ 
loads.16  These  spring  preloads  should  directly  oppose  the  locating  points.  If 
the  irregular  shape  of  the  prism  prevents  direct  opposition  of  the  locating  points 
by  the  retaining  springs,  two  alternate  retainer  designs  are  used.  A  central 
retainer,  equidistant  from  the  locating  points,  provides  an  even  distribution 
of  support.  The  other  approach  uses  a  broad  area  of  contact  between  prism  and 
retainer.  A  retainer  contoured  to  fit  the  irregular  surfaces  of  the  prism  is  used; 
contact  between  retainer  and  prism  is  made  through  an  intermediate  elastomer 
pad.  This  last  design,  with  its  large  areas  of  contact,  is  good  for  environments 
subjected  to  high  accelerations  or  mechanical  shock.  Figure  3.5  shows  a  ki¬ 
nematic  prism  mount. 

Flexure  mounting  of  the  prism  accommodates  large  changes  in  temperature. 
Flexure  mounting  is  similar  to  kinematic  mounting  in  that  mounting  points 
are  chosen  using  kinematic  principles.  Each  mounting  point  is  connected  to  a 
flexure.  Each  flexure  has  the  necessary  degrees  of  compliance  and  restraint  to 
locate  the  prism  while  providing  for  expansion  or  contraction  of  the  mount 
with  respect  to  the  prism.17 
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Fig.  3.5  Kinematic  prism  mount. 


Flexures  are  very  similar  to  springs.  Flexures  provide  controlled  motion 
through  elastic  deformation,  while  springs  provide  controlled  force  through 
elastic  deformation.  For  optical  mounting  purposes,  flexures  are  normally  made 
in  the  form  of  cantilever  springs,  providing  either  translation  or  rotation.  For 
example,  a  classic  flexure  mount  for  a  prism  consists  of  three  flexures  bonded 
to  one  face  of  the  prism.  Each  flexure  is  compliant  in  a  plane  parallel  to  the 
prism  face,  and  is  stiff  in  the  direction  normal  to  the  prism  face.  The  axis  of 
compliance  of  each  of  the  three  flexures  is  directed  toward  the  center  of  gravity 
of  the  prism  in  the  plane  of  the  flexures.  This  flexure  arrangement  allows  the 
mount  to  expand  or  contract  relative  to  the  prism  without  introducing  any 
rotation  of  the  prism.  Figure  3.6  shows  a  flexure  mount  for  a  prism. 


3.3.4  Large  Contact  Area  Mounts  for  Prisms 

High  accelerations  may  create  local  stresses  in  bonded  or  kinematic  mounted 
prisms  that  are  high  enough  to  induce  failure  in  the  prism  material.  Mounting 
stresses  are  reduced  if  the  contact  area  between  prism  and  mount  is  increased. 
In  the  limiting  case,  the  mounting  area  is  the  same  size  as  the  prism  face.  For 
this  limiting  case,  the  maximum  acceleration  tolerable  before  prism  failure  is 
given  by: 

a  =  —  (3.36) 

P  h  ’ 
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Flexures  Are  Compliant  in 
Direction  of  Prism  CG  to 
Remove  Mismatch  in  « 
Between  Prism  and  Mount 


Fig.  3.6  Prism  flexure  mount. 


where 

h  =  prism  thiekness 
( jf  =  prism  material  yield  strength 
a  =  acceleration  (in  dimensionless  g) 
p  =  prism  material  density. 

For  a  typical  prism  material  such  as  BAK-4  glass,  with  a  density  of  3.1  kg  m-3, 
and  a  tensile  yield  strength  of  approximately  7  MPa,  a  prism  thickness  of 
50  mm  tolerates  about  446  g. 

Although  the  large  area  of  contact  increases  the  chances  of  survival  of  the 
prism  under  high  acceleration  conditions,  this  advantage  is  offset  by  some  very 
serious  disadvantages.  The  mounting  surface  for  the  prism  must  be  flat  and 
have  the  same  tolerance  as  the  optical  surface  of  the  prism.  Large  optically 
flat  mounting  surfaces  are  expensive  to  produce.  A  change  in  temperature  can 
induce  large  stresses  in  the  interface  between  prism  and  mount.  Finally,  the 
great  strength  of  the  large  area  of  contact  is  applicable  only  to  accelerations 
perpendicular  to  the  mounting  surface.  An  acceleration  parallel  to  the  mount¬ 
ing  surface  induces  large  shear  stresses. 

Normally,  a  large  contact  area  mount  is  designed  using  semikinematic  prin¬ 
ciples.  Clamping  forces  are  applied  to  the  prism  using  spring-loaded  plates 
that  directly  oppose  the  mounting  surface;  this  method  places  the  glass  in 
compression.  An  elastomer  pad  can  be  used  to  replace  the  spring  preload  in 
the  clamp.  Multiple  contacting  surfaces  are  used,  with  support  provided  for 
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Fig.  3.7  Large  contact  area  prism  mount. 


all  prism  surfaces  except  the  input  and  output  faces  of  the  prism.  Figure  3.7 
shows  a  large  contact  area  mount  for  a  prism. 


3.4  LENS  MOUNTING 

Distortion  of  the  lens  surfaces  can  lead  to  performance  degradation,  therefore 
requiring  a  low-stress  mounting  design.  At  the  same  time,  the  lens  mount 
must  maintain  the  position  of  the  lens  to  much  tighter  tolerances  than  are 
customary  for  normal  mechanical  systems. 

3.4.1  General  Considerations  in  Lens  Mounting 

Although  tolerances  of  less  than  100  nm  are  routinely  achieved  in  the  fabri¬ 
cation  of  optical  surfaces,  mechanical  tolerances  on  the  mounting  surfaces  of 
lenses  are  literally  several  orders  of  magnitudes  larger  than  optical  tolerances. 
Assuming  normal  optical  fabrication  shop  practice,  the  smallest  mechanical 
tolerance  that  is  readily  and  economically  produced  on  a  lens  is  about  25  p,m. 
Smaller  tolerances,  particularly  with  respect  to  centering,  require  very  large 
increases  in  production  time  and  cost.18 

Lens  Centering.  Centering  of  the  lens  is  the  most  important  of  all  mechanical 
tolerances.  Centering  is  defined  as  the  error  in  location  between  the  optical 
axis  of  the  lens  and  the  mechanical  axis  of  the  lens.  Traditionally,  lens  cen¬ 
tering  is  defined  with  respect  to  an  optical  measurement.  The  lens  is  placed 
on  a  hollow  centering  bell  and  illuminated  with  parallel  light.  The  focus  of 
the  lens  is  found  and  the  lens  and  bell  are  then  rotated.  As  the  bell  rotates, 
an  error  in  centering  of  the  lens  causes  the  focus  to  describe  a  circle.  The 
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diameter  of  the  circular  motion  of  the  focus  divided  by  the  focal  length  of  the 
lens  is  an  angular  measure  of  the  centering  of  the  lens  and  is  given  in  arc 
minutes.19  This  technique  is  limited  to  lenses  transmitting  in  the  visible  and 
with  focal  lengths  and  centering  errors  that  are  easy  to  measure.  Very  short 
or  very  long  focus  lenses,  or  lens  materials  that  do  not  transmit  in  the  visible, 
are  not  suited  for  use  with  this  method.  A  wide  variety  of  centering  techniques 
exist,  and  are  discussed  in  the  literature  on  lens  fabrication.20  More  and  more 
often,  designers  are  specifying  the  required  centering  and  leaving  the  test 
method  up  to  the  fabrication  shop. 

One  such  method  of  specifying  centering  is  to  specify  the  locations  of  the 
centers  of  curvature  of  the  two  lens  surfaces  with  respect  to  the  mechanical 
axis  of  the  lens.  Using  standard  mechanical  tolerance  practice,  the  outer  cy¬ 
lindrical  surface  of  the  lens  is  defined  as  a  datum  surface.  The  locations  of  the 
centers  of  curvature  of  the  lens  surfaces  are  then  determined  with  respect  to 
surfaces  perpendicular  to  the  datum  surface.  Normally,  two  perpendicular 
surfaces  are  used  and  each  perpendicular  surface  is  coincident  with  the  lens 
surface  at  the  mechanical  axis  of  the  lens.  (Note  that  the  perpendicular  surfaces 
are  not  tangent  to  the  vertices  of  the  lens  surfaces,  since  these  vertices  may 
lie  off  the  mechanical  axis  of  the  lens.)  Two  lines  are  defined  with  one  line 
passing  through  the  lens  surface  center  of  curvature  and  the  center  of  the 
perpendicular  surface.  The  other  line  is  the  mechanical  axis  of  the  lens.  The 
angle  between  these  two  lines  defines  the  centering  of  the  surface.21 


Center  of  Gravity  and  Weight  Estimates  for  Lenses.  Lenses  consist  of  three 
basic  shapes:  the  right  circular  cylinder,  the  truncated  cone  (or  beveled  disk), 
and  the  spherical  segment.  These  three  basic  shapes  are  combined  to  find  the 
weight  and  center  of  gravity  of  the  lens  22 

Weight  and  center  of  gravity  of  the  disk  or  right  circular  cylinder  are  given  by: 


WD  =  ^p hD2  ,  (3.37) 

CGd  =  \  .  (3.38) 

A 

Weight  and  center  of  gravity  of  the  truncated  cone  or  beveled  disk  are  given  by: 


Wc  =  h(D  -  Dd  +  d2)  , 
iz 


(3.39) 


CGc 


h  D/2  4-  d 
3  D/2  +  dl 2  ' 


(3.40) 


Weight  and  center  of  gravity  of  the  spherical  segment  are  given  by: 


(3.41) 
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(3.42) 


CGX 


hs  (4g  -  frs) 

4  (SR  -  hs)  ’ 


In  the  preceding  equations 


(3.43) 


W  -  lens  weight 

p  =  lens  material  density 

h  =  thickness 

hs  =  sagittal  thickness  of  a  spherical  segment,  measured  from  flat 
side  to  vertex 
D  =  diameter 

<i  =  smaller  diameter  (for  a  beveled  disk) 

CGd  =  center  of  gravity  location  of  a  disk 

CGc  =  center  of  gravity  location  of  a  beveled  disk,  measured  from  the 
smaller  diameter 

CGS  =  center  of  gravity  location  of  a  spherical  segment,  measured 
from  the  flat  side 

R  -  radius  of  curvature  of  a  spherical  segment. 

Once  the  weights  and  center  of  gravity  locations  of  the  individual  basic 
shapes  of  the  lens  are  known,  the  overall  weight  and  center  of  gravity  location 
is  found  from: 


WL  =  Xw,  ,  (3.44) 

i  =  1 

icG!W! 

CGl  =  ,  (3-45) 

where 

Wl  =  overall  lens  weight 

Wi  =  weight  of  a  basic  shape  (negative  for  concave  spherical  shapes) 

CGl  =  center  of  gravity  of  the  lens,  with  respect  to  the  datum 
(normally  taken  as  one  of  the  vertices  of  the  lens) 

CG;  =  center  of  gravity  of  the  individual  basic  shapes,  taken  with 
respect  to  the  same  datum. 

In  many  cases,  an  approximate  method  is  more  suitable  for  finding  the  weight 
and  center  of  gravity.  Most  lenses  are  combinations  of  spherical  and  cylindrical 
shapes;  the  beveled  disk  is  not  commonly  used.  If  the  curvature  of  the  spherical 
surface  is  such  that  the  sagittal  thickness  is  less  than  half  the  radius  of  cur¬ 
vature,  an  approximate  method  for  finding  the  weight  and  center  of  gravity 
of  a  spherical  segment  is  used: 
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CGS  =  ^  ,  (3.47) 

where  Ws  is  the  weight  of  the  spherical  segment. 

3.4.2  Bonded  Lens  Mounts 

Bonding  the  lens  into  its  mount  is  a  simple  and  economical  way  to  mount 
lenses.  Two  different  bonding  techniques  are  used:  a  thin,  high-strength  direct 
bond,  and  a  thick,  semiflexible  bond. 

Direct  Bonding  of  Lens  Mounts.  In  direct  bonding,  a  thin,  high-strength  bond 
is  produced  between  lens  and  mount.  To  produce  maximum  accuracy,  me¬ 
chanical  contact  should  exist  between  the  optical  surfaces  of  the  lens  and  the 
mount.  Adhesive  should  be  limited  to  the  circumference  of  the  lens,  or  to  the 
area  outside  the  circle  of  contact  between  lens  surface  and  mechanical  seat  in 
the  lens  cell. 

Mechanical  clearance  considerations  may  limit  the  adhesive  thickness  to 
below  that  desired  for  optimum  properties.  If  this  is  the  case,  a  groove  can  be 
machined  into  the  cell  to  accommodate  the  adhesive.  Injection  holes  are  used 
to  place  the  adhesive  into  the  groove.  For  a  typical  lens  diameter  of  25  to 
50  mm,  and  for  normal  optical  adhesives,  six  equally  spaced  radial  injection 
holes,  1  to  1.5  mm  in  diameter  are  sufficient.  Spread  of  the  adhesive  is  checked 
by  looking  through  the  lens.  If  the  lens  material  is  not  transparent  in  the 
visible,  adhesive  bond  progress  is  monitored  by  placing  additional  "'witness” 
holes  between  the  injection  holes.  Adhesive  is  injected  until  it  begins  to  flow 
out  the  witness  holes. 

The  enormous  number  of  possible  adhesives,  and  the  rapid  change  in  avail¬ 
ability  of  commercial  adhesives,  makes  it  impossible  to  tabulate  the  properties 
of  adhesives  here.  Several  important  properties  should  be  considered  in  se¬ 
lecting  an  adhesive  for  optical  applications23: 

1.  Most  adhesives  shrink  during  curing.  This  may  cause  a  shift  in  lens 
position  after  the  adhesive  sets.  One  solution  is  to  lock  the  lens  in 
position  mechanically,  and  then  inject  the  adhesive  around  the  lens. 
Another  solution  is  to  adjust  the  position  of  the  lens  continuously  in 
smaller  and  smaller  increments  as  the  adhesive  sets. 

2.  Shrinkage  of  the  adhesive  during  curing  produces  residual  stress  in 
the  lens.  Some  of  this  stress  is  reduced  by  increasing  the  cure  time  of 
the  adhesive. 

3.  Ultraviolet  setting  adhesives  are  very  convenient  for  lens  bonding. 
These  adhesives  remain  relatively  fluid  until  illuminated  by  a  strong 
uv  light  source.  These  uv  curing  adhesives  shrink  during  curing.  Residual 
stress  in  uv  curing  adhesives  is  reduced  by  lengthening  curing  time. 

4.  Many  adhesives  evolve  a  gas  during  curing  and  may  outgas  in  a  vac¬ 
uum.  The  cyanoacrylic  adhesives  are  particularly  bad  in  this  respect 
and  should  not  be  used  in  a  vacuum  environment. 

5.  There  are  solvents  available  that  dissolve  any  adhesive.  These  solvents 
are  often  toxic  and  slow  to  take  effect.  Heat  can  also  cause  some 
adhesives  to  lose  strength,  allowing  removal  of  the  lens  from  the  mount. 

6.  Hard,  high-strength  bonds  are  not  flexible.  A  change  in  temperature 
can  induce  very  large  stresses  between  lens  and  mount. 
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Semiflexible  Bonding  of  Lenses  into  Mounts.  Semiflexible  adhesives  are  used 
in  relatively  thick  bonds  to  isolate  the  lens  from  temperature  effects,  and  in 
some  cases,  against  mechanical  shock  and  vibration.  The  adhesive  forms  a 
thick  ring  between  the  outer  diameter  of  the  lens  and  the  inner  diameter  of 
the  lens  cell.  If  properly  designed,  this  thick  ring  of  adhesive  maintains  the 
correct  centering  location  of  the  lens  as  the  temperature  changes.  At  the  same 
time,  the  thick  adhesive  layer  maintains  the  lens  in  a  low  stress  condition. 
Axial  location  of  the  lens  is  normally  obtained  via  mechanical  contact  between 
the  optical  surface  of  the  lens  and  the  seat  of  the  cell.24 

The  optimum  thickness  of  adhesive  between  lens  and  cell  to  produce  a  zero 
stress  condition  in  the  lens  as  the  temperature  changes  is  given  by25: 


Dgi&m  &g) 
2(o Lr  —  0 Lm) 


(3.48) 


where 

hr  =  required  adhesive  radial  thickness 

Dg  =  lens  outer  diameter 

a#  =  lens  thermal  coefficient  of  expansion 

am  =  lens  cell  thermal  coefficient  of  expansion 

ar  =  adhesive  thermal  coefficient  of  expansion  (for  the  silastic 

adhesives  often  used  in  this  application,  this  is  about  200  x 
10“  6  m/m  K). 

The  thickness  of  adhesive  given  by  Eq.  (3.48)  is  relatively  large  in  comparison 
with  normal  adhesive  bonding  practice.  Adhesive  thicknesses  of  several  milli¬ 
meters  are  not  uncommon.  The  large  adhesive  thickness  used  in  this  method 
requires  that  the  lens  be  mechanically  centered  with  respect  to  the  mechanical 
axis  of  the  lens  cell  before  adding  the  adhesive.  This  mechanical  centering  is 
achieved  through  the  use  of  radial  screws  or  shims.  In  either  case,  a  release 
agent  is  placed  on  the  mechanical  adjustment  to  allow  removal  after  curing 
of  the  adhesive. 

Under  the  weight  of  the  lens  the  very  thick  layer  of  semiflexible  adhesive 
deflects  causing  the  lens  to  move  with  respect  to  the  cell.  The  radial  deflection 
of  the  center  of  a  lens  mounted  in  a  semiflexible  adhesive  mount  is  given  by26: 


_ Wl _ 

(TTl2)dG(hG/hr)(Er/(l  -  V2)  +  Gr ] 


(3.49) 


where 

8l  =  decentering  of  the  lens  with  respect  to  the  mount 
Wl  =  lens  weight 
g?g  =  lens  diameter 

Hg  =  length  of  adhesive  in  contact  with  the  side  of  the  lens 
Er  -  elastic  modulus  of  the  adhesive 
vr  =  Poisson’s  ratio  of  the  adhesive 
Gr  =  shear  modulus  of  the  adhesive. 

Figure  3.8  shows  a  semiflexible  adhesive  bonded  lens. 
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Fig.  3.8  Semifiexible  adhesive  bonded  lens. 


3.4.3  Shimmed  Mounts 

Assembly  of  the  lens  into  its  cell  is  made  relatively  easy  by  large  radial  clear¬ 
ances  between  the  outer  diameter  of  the  lens  and  the  inner  diameter  of  the 
cell.  Such  large  clearances  limit  assembly  precision.  Assembly  precision  can 
be  reestablished  by  placing  a  shim  between  the  lens  and  bore  of  the  cell. 

A  metal  shim  is  easy  to  place  between  the  cell  and  lens.  Brass  or  stainless 
steel  shims  are  the  most  common.  A  full  circle  of  contact  is  common  between 
cell,  lens,  and  shim.  Use  of  a  semikinematic  three-point  contact  set  of  shims 
requires  the  use  of  adhesives  to  lock  the  shims  in  place.  Metal  shims  are  easy 
to  install,  are  stable,  and  provide  good  accuracy.  Unfortunately,  metal  shims 
do  not  provide  any  isolation  from  expansion  or  contraction  of  the  lens  cell  with 
respect  to  the  lens.  Metal  shims  are  therefore  restricted  to  relatively  limited 
changes  in  temperature. 

Larger  temperature  changes  are  accommodated  through  the  use  of  semiflex- 
ible  shims.  A  mylar  shim  offers  stability  and  accuracy  of  centering  while  at 
the  same  time  providing  sufficient  elasticity  to  isolate  the  lens  from  changes 
in  cell  size  due  to  temperature  fluctuations.  Mylar  shims  are  installed  under 
slight  compression.  Sufficient  compression  is  provided  so  that  during  expansion 
of  the  cell  the  shim  remains  in  compression.  Should  the  shim  compression  be 
removed  due  to  a  change  in  temperature,  the  shim  would  become  loose  and 
the  lens  could  move  with  respect  to  the  cell. 

Like  the  metal  shim,  mylar  shims  normally  are  in  full  contact  around  the 
circumference  of  the  lens.  To  simplify  installation,  the  mylar  shim  is  cut  into 
three  equal-length  (120-deg)  segments.  Normal  mylar  shim  thickness  is  80  to 
130  jim.  It  is  suggested  that  the  actual  as-fabricated  diameters  of  lens  and  cell 
bore  be  measured  and  the  shim  thickness  selected  to  match. 

Under  mechanical  shock  and  vibration,  a  semifiexible  mylar  shim  may  shift 
position  around  the  edge  of  the  lens  causing  the  lens  to  move.  Motion  of  the 
shim  is  eliminated  by  locking  shim,  lens,  and  cell  together.  This  is  accomplished 
by  adhesive  bonding.  A  radial  hole  is  punched  in  the  center  of  each  shim 
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Fig.  3.9  Shimmed  lens  mount. 


segment.  The  holes  in  the  shim  segments  are  aligned  with  radial  adhesive 
injection  holes  in  the  cell.  Injecting  adhesive  locks  shim,  cell,  and  lens  together. 
Because  the  adhesive  is  used  as  a  lock  and  is  encapsulated,  stability  and 
outgassing  of  the  adhesive  are  reduced  concerns.27 
Figure  3.9  shows  a  shimmed  lens  mount. 


3.4.4  Seat  and  Retainer  Mounts 

Use  of  a  mechanical  seat  and  retainer  is  the  classic  means  of  lens  mounting. 
This  method  offers  good  accuracy  and  stability  at  the  expense  of  high  stresses 
in  the  metal-to-glass  interface. 

Accuracy  of  Assembly.  Accuracy  of  assembly  using  the  seat  and  retainer 
lens  mount  is  limited  by  the  clearance  required  for  free  assembly  between  the 
lens  outer  diameter  and  cell  bore.  A  minimum  radial  clearance  of  25  p,m  is 
required  for  free  assembly.  Assuming  a  cell  diameter  tolerance  of  ±  25  p,m, 
and  a  cell  bore  diameter  tolerance  of  ±  25  jxm,  the  maximum  centering  tol¬ 
erance  achieved  using  contact  between  lens  and  cell  bore  is  75  p,m.  Radial 
clearance  is  reduced  by  heating  of  the  cell  during  assembly  to  obtain  sufficient 
clearance.  Any  reduction  of  radial  assembly  clearance  increases  the  chances 
of  the  lens  binding  in  the  cell  during  assembly.  If  the  lens  does  bind,  the  chances 
of  freeing  it  without  damage  are  small.  Producing  a  full  spherical  radius  on 
the  edge  of  the  lens,  with  the  radius  coincident  with  the  lens  optical  axis,  can 
reduce  the  possibility  of  the  lens  binding  during  assembly.  Producing  such  a 
spherical  radius  is  expensive  and  may  compromise  the  centering  accuracy  of 
the  lens. 

If  either  or  both  of  the  lens  optical  surfaces  have  a  strong  spherical  radius 
of  curvature,  the  centering  accuracy  of  the  lens  in  the  cell  bore  may  be  improved 
through  self-centering.  A  lens  with  spherical  surfaces  in  contact  with  two 
coaxial  rings  tends  to  center  under  the  axial  clamping  force  of  the  two  coaxial 
rings.  This  self-centering  is  exploited  during  mass  production  of  lenses  in  a 
centering  bell.  The  accuracy  achieved  by  self-centering  is  determined  by  the 
coefficient  of  friction  between  the  lens  and  cell  and  by  the  contact  angle  between 
optical  surfaces  and  cell.  As  a  rough  rule  of  thumb,  the  optical  radius  of  cur¬ 
vature  necessary  for  self-centering  to  become  effective  is  about  0.5  m.  For  low 
friction  coefficients  and  strong  surface  curvatures,  a  lens  may  self-center  in  a 

OQ 

cell  to  an  accuracy  of  10  |im. 
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Fig.  3.10  Seat  and  retainer  contact  geometry:  (a)  sharp  corner  contact,  (b)  tangent  contact, 
ad  (c)  spherical  contact. 


Seat  and  Retainer  Geometry.  The  geometry  of  contact  between  a  lens  and 
cell  determines  the  stress  produced  in  the  area  of  contact.  Three  types  of  contact 
are  possible  between  the  cell  and  lens: 

1.  Sharp  corner  contact:  Contact  between  lens  and  metal  is  made  at  a 
sharp  edge,  usually  with  a  90-deg  angle.  This  is  an  easy  design  to 
tolerance,  but  is  a  high-stress  configuration.  Production  of  a  true  sharp 
edge  without  burrs  that  reduce  precision  is  difficult.  This  production 
difficulty  is  reduced  at  the  cost  of  requiring  more  radial  space  outside 
the  clear  aperture  by  changing  the  included  angle  to  135  deg. 

2.  Tangential  contact:  Tangential  contact  between  glass  and  metal  is  a 
lower  stress  design  than  the  sharp  corner,  and  is  easier  to  produce. 
More  radial  clearance  outside  the  clear  aperture  is  required  with  this 
design  in  comparison  with  the  sharp  corner  contact.  Tangential  contact 
is  not  possible  with  a  concave  surface,  requiring  the  use  of  a  separate 
mounting  surface.  Use  of  a  separate  mounting  surface  increases  cost 
and  lowers  precision. 

3.  Spherical  contact:  A  spherical  seat  with  a  radius  of  curvature  matching 
the  optical  surface  of  the  lens  is  the  lowest  contact  stress  design  pos¬ 
sible.  Fabrication  and  tolerancing  of  the  spherical  contact  are  very 
difficult.  More  radial  clearance  outside  the  clear  aperture  of  the  lens 
is  required  with  the  spherical  contact  than  with  the  sharp  corner 
design.  The  use  of  spherical  contact  should  be  restricted  to  lens  cells 
subjected  to  high  accelerations. 

Figure  3.10  shows  the  three  types  of  contact  geometries. 

Retainer  Design.  Normally,  the  retainer  is  used  to  preload  the  lens  and  to 
ensure  contact  of  the  lens  with  the  seat  of  the  cell.  The  retainer  should  not  be 
considered  as  a  precision  mechanical  element.  Retainer  preload  force  must  be 
large  enough  so  that  under  any  loading  conditions  the  direction  of  the  preload 
force  does  not  change.  For  typical  military  aviation  applications,  a  preload 
force  of  up  to  about  10  times  the  weight  of  the  lens  is  required.  A  reduced 
preload  is  used  for  systems  in  a  static  laboratory  environment.  To  allow  for 
accelerations  produced  during  shipping  and  handling,  a  minimum  preload  force 
of  two  to  four  times  the  weight  of  the  lens  is  suggested. 

For  lens  diameters  up  to  0.3  m,  the  retainer  is  provided  with  an  outside 
thread  matched  to  the  thread  of  the  cell.  A  loose  fit  between  retainer  and  cell 
threads  corresponding  to  a  class  1  thread  fit  is  very  desirable.  A  loose  thread 
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fit  allows  the  assembly  technician  to  determine  when  the  lens  first  contacts 
the  retainer  and  also  allows  the  retainer  to  self-align  against  the  lens  to 
produce  uniform  contact  around  the  circumference  of  the  lens.  The  torque 
required  to  turn  the  retainer  is  related  to  the  desired  axial  preload  by29: 

T  =  0.2  dF  ,  (3.50) 

where  F  is  the  desired  axial  preload  force,  T  is  the  retainer  torque,  and  d  is 
the  retainer  diameter.  Very  large  retainer  rings  are  provided  with  a  bolt  circle. 
Control  of  axial  preload  with  a  large  number  of  bolts  is  extremely  difficult. 

Some  axial  compliance  in  the  retainer  may  be  required  for  lens  cells  exposed 
to  large  drops  in  temperature.  The  retainer  may  be  faced  with  a  silicone  sponge 
sheet  (normally  about  12  durometers).  Alternatively,  an  O-ring  can  be  placed 
in  the  retainer  to  act  as  an  elastic  element.  An  O-ring  of  about  70  durometers 
is  used  and  is  compressed  to  50  to  75%  of  nominal.  Yet  another  approach  is 
to  incorporate  a  diaphragm  flexure  into  the  retainer.  A  diaphragm  flexure  is 
produced  in  a  retainer  by  cutting  a  deep  groove  on  the  inside  diameter  of  the 
retainer,  almost  to  the  outside  of  the  retainer.  The  outer  diameter  of  the  groove 
produced  should  be  greater  than  the  mechanical  diameter,  or  at  least  the 
contact  diameter  of  the  lens. 

Mechanical  Stress  in  the  Lens  and  Cell.  The  maximum  stress  tolerable  in 
a  lens  is  estimated  using  the  stress-optical  coefficient,  a  lens  material  property . 
This  property  is  also  known  as  the  stress  birefringence  of  the  lens  material. 
The  stress-optical  coefficient  determines  the  change  in  index  of  refraction  of 
the  material  with  applied  stress.  The  optical  path  difference  due  to  an  applied 
stress  on  the  lens  is  estimated  by: 


OPD  =  Khv  ,  (3-51) 

where 

OPD  =  optical  path  difference  (or  stress  birefringence) 

h  =  lens  thickness 

cr  =  applied  stress 

K  =  stress-optical  coefficient. 

If  the  retainer  and  seat  do  not  contact  the  lens  on  a  common,  coaxial  diameter, 
bending  stress  is  induced  in  the  lens  due  to  the  preload.  The  magnitude  of  this 
stress  is  estimated  from30: 
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where 

cr  =  induced  bending  stress 

F  =  preload  force  on  the  lens 

do  =  diameter  of  contact  between  seat  and  lens 

di  =  diameter  of  contact  between  retainer  and  lens 

h  =  center  thickness  of  the  lens 

v  =  Poisson’s  ratio  for  the  lens  material. 


OPTOMECHANICAL  SYSTEM  DESIGN  149 


Additional  mechanical  stress  is  produced  in  the  area  of  contact  between  lens 
and  seat  or  retainer.  This  contact  stress  is  estimated  using  the  Hertz  contact 
stress  theory.  Contact  stresses  are  highly  localized  and  are  usually  more  of  a 
concern  with  respect  to  structural  failure  than  the  optical  performance. 

To  use  the  Hertz  contact  stress  theory  to  estimate  contact  stress  due  to  a 
sharp  corner  in  contact  with  the  lens,  it  is  necessary  to  assume  that  the  sharp 
corner  has  some  finite  radius  of  curvature.  For  metallic  retainers  produced  by 
conventional  machining  operations,  the  sharp  edge  can  be  assumed  to  have  a 
radius  of  about  50  pjn .  The  contact  stress  is  then  given  by31: 

FI2nr[(dG  +  dm)ldGdm  ] 

(1  -  v2g)IEg  +  (1  -  v2J!E 


(3.53) 


where 

cr  =  contact  stress 

F  =  retainer  preload  force  on  the  lens 

dG  =  twice  the  lens  optical  radius  of  curvature 

dm  =  twice  the  radius  of  curvature  of  the  sharp  edge 

vg  -  Poisson's  ratio  for  the  lens  material 

Vm  =  Poisson’s  ratio  for  the  cell  material 

Eg  —  the  modulus  of  elasticity  of  the  lens  material 

Em  =  the  modulus  of  elasticity  of  the  cell  material 

r  =  the  radial  distance  of  the  contact  from  the  lens  axis. 

A  very  similar  equation  is  used  to  find  the  contact  stress  due  to  a  tangential 
contact  with  the  lens: 


a  -  0.798 
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(3.54) 


Thermal  Stresses  in  the  Lens  Due  to  Mounting.  Because  of  the  difference  in 
thermal  coefficient  of  expansion  between  optical  and  structural  (metallic)  ma¬ 
terials,  stresses  are  induced  in  the  lens  due  to  changes  in  temperature.  In 
particular,  a  drop  in  temperature  may  produce  severe  stresses  in  the  lens. 
These  stresses  may  affect  the  optical  performance  of  the  lens,  and  in  the  worst 
case,  cause  mechanical  failure. 

To  avoid  radial  stress  in  the  lens  produced  as  the  cell  contracts  due  to  a 
temperature  change,  there  must  be  some  initial  clearance  between  the  lens 
and  cell  bore.  The  minimum  radial  clearance  required  to  ensure  that  the  cell 
does  not  contact  the  lens  in  the  radial  direction  during  a  drop  in  temperature 
is  given  by 

hr  =  ”ATdG(am  ~  otG)  —  -&T(dmam  ~  >  (3.55) 

where 

hr  =  minimum  radial  clearance 

A  T  =  temperature  drop 
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dG  =  lens  outer  diameter 
dm  =  cell  inner  diameter 

aG  =  thermal  coefficient  of  expansion  of  the  lens  material 
am  =  thermal  coefficient  of  expansion  of  the  cell  material. 

If  sufficient  radial  clearance  is  not  provided  between  lens  and  cell,  a  drop  in 
temperature  induces  a  radial  stress  in  the  lens.  This  radial  stress  is  estimated 
from25: 
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where 

c Tr  =  radial  stress  induced  in  the  lens 
rG  =  lens  radius 
hr  -  initial  radial  clearance 
hm  =  cell  wall  thickness. 


3.5  LENS  BARRELS 

The  lens  barrel  provides  environmental  protection  and  maintains  the  correct 

spacing  between  lens  elements. 

3.5.1  Barrel  Materials 

Properties  desirable  in  a  lens  barrel  material  are: 

1.  thermal  coefficient  of  expansion  match  with  the  lens  material 

2.  low  density  to  reduce  weight 

3.  high  elastic  modulus  to  reduce  structural  deformation 

4.  low  material  cost 

5.  low  machining  cost 

6.  dimensional  stability 

7.  resistance  to  corrosion 

8.  easy  to  blacken,  to  reduce  stray  light. 

Materials  used  for  lens  barrels  include: 

1.  Magnesium  alloys:  primarily  used  to  reduce  weight  and  fabrication 
cost.  They  have  a  high  thermal  coefficient  of  expansion  in  comparison 
with  most  lens  materials,  and  poor  resistance  to  corrosion. 

2.  Aluminum  alloys:  used  to  reduce  weight  and  fabrication  cost.  Alu¬ 
minum  casting  alloys,  such  as  356,  are  used  to  reduce  the  cost  of 
complex  barrel  structures.  The  best  dimensional  stability  is  attained 
in  6061,  although  7075  is  a  good  substitute.  These  have  a  high  thermal 
coefficient  of  expansion  in  comparison  with  most  lens  materials.  They 
may  be  blackened  using  an  anodizing  process,  although  anodizing  may 
produce  a  change  in  physical  size. 
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3.  Titanium  alloys:  used  to  reduce  weight  and  to  obtain  a  good  thermal 
coefficient  of  expansion  match  with  lens  materials.  They  are  expensive 
to  fabricate.  The  6A1-4V  alloy  is  most  commonly  encountered.  These 
have  a  very  good  resistance  to  corrosion. 

4.  Stainless  steel:  used  for  corrosion  resistance  and  to  obtain  a  good  ther¬ 
mal  coefficient  of  expansion  match  with  lens  materials.  It  is  more 
expensive  to  fabricate  than  aluminum,  but  cheaper  than  titanium. 
Type  416  is  relatively  easy  to  machine  and  may  be  chemically  black¬ 
ened  without  a  physical  change  in  size.  Type  17-4  PH  (precipitation 
hardening)  has  superior  dimensional  stability  and  resistance  to  cor¬ 
rosion.  The  300  series  are  used  for  vacuum  applications;  unfortunately, 
these  alloys  have  poor  dimensional  stability. 

5.  Brass:  used  for  corrosion  resistance  and  to  obtain  a  good  thermal  coef¬ 
ficient  of  expansion  match  with  lens  materials.  It  is  heavy  and  more 
expensive  to  fabricate  than  aluminum.  It  is  not  as  corrosion  resistant 
as  stainless  steel.  "Naval  brass”  has  superior  dimensional  stability.  It 
is  often  used  in  combination  with  either  aluminum  or  stainless  steel 
to  obtain  good  friction  and  wear  resistance  in  moving  parts. 

6.  Beryllium:  used  primarily  for  extreme  weight  reduction.  It  has  an 
excellent  stiffness-to-weight  ratio  and  has  a  thermal  coefficient  of  ex¬ 
pansion  about  half  that  of  aluminum.  It  is  very  expensive  to  fabricate, 
is  brittle,  and  very  vulnerable  to  corrosion. 

7.  Composites:  Composite  materials  are  used  primarily  to  reduce  weight 
and  to  provide  a  better  thermal  coefficient  of  expansion  match  with 
lens  materials.  They  are  very  expensive  to  fabricate,  and  their  prop¬ 
erties  may  deteriorate  in  the  presence  of  moisture. 

8.  Plastics:  Polycarbonates,  and  in  particular  the  glass-reinforced  poly¬ 
carbonates,  are  the  most  common  plastics  used  for  lens  barrels.  Plastics 
are  used  to  reduce  weight  and  fabrication  cost.  A  secondary  advantage 
is  resistance  to  corrosion.  They  have  poor  dimensional  stability. 

Metallic  and  nonmetallic  materials’  properties  are  given  in  Tables  3.4  and  3.5, 
respectively. 

3.5.2  Barrel  Design 

Common  Bore  Assembly.  The  simplest  configuration  of  a  barrel  is  a  common 
bore  assembly.  In  a  common  bore  assembly,  all  components — lenses,  retainer, 
and  spacers — are  made  to  the  same  outer  diameter  and  then  placed  in  a  barrel 
with  a  single  common  bore.  Spacing  between  elements  is  maintained  by  spacers 
and  a  single  retainer  provides  the  preload  force  for  the  entire  assembly.  Friction 
between  the  components  and  the  barrel  bore  makes  it  difficult  to  ensure  contact 
between  all  spacers  and  lenses.  Since  the  retainer  must  keep  all  elements  in 
contact,  the  preload  force  tends  to  be  very  high. 

Figure  3.11  shows  a  common  bore  assembly. 

Individual  Seat  Assembly.  In  many  cases,  the  diameters  of  the  individual 
lenses  will  vary.  Typically,  the  lens  diameters  will  uniformly  increase  or  de¬ 
crease  along  the  optical  axis  in  the  direction  toward  or  away  from  a  stop.  In 
this  case,  an  individual  seat  and  retainer  can  be  provided  for  each  element  in 
the  barrel.  For  maximum  precision,  the  seat  can  be  machined  to  match  the 
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2.71 

1.85 

8.94 

10.2 

4.43 

1.85 

8.25 

8.03 

8.03 

2.91 

Material 

Aluminum  (6061-T6) 

Beryllium  (1-70) 
Copper  (OFHC) 
Molybdenum  (TZM) 
Titanium  (6AL-4V) 

Magnesium 
(AZ  31B) 

Beryllium  copper 
(Cu-2Be) 

Invar  36 

Stainless  steel 
(Type  310) 

Aluminum-silicon 
carbide  (SXA  24-T6) 

Table  3.5  Nonmetallic  Materials  Properties 


OPTOMECHANICAL  SYSTEM  DESIGN  153 


154  IR/EO  HANDBOOK 


Fig.  3.11  Common  bore  assembly. 


Fig.  3.12  Individual  seat  assembly. 


measured  diameter  of  the  lens  exactly.  To  guarantee  centering  of  the  individual 
lens  elements,  the  critical  portions  of  the  barrel  should  be  machined  in  a  single 
setup. 

Figure  3.12  shows  an  individual  seat  assembly. 

Subcell  Assembly.  Maximum  precision  of  the  barrel  assembly  is  obtained 
using  subcell  assembly.  In  subcell  assembly,  individual  subcells  each  contain¬ 
ing  an  element  are  interference  fitted  (press  fitted)  into  a  common  ore.  The 
centering  error  is  then  the  sum  of  the  centering  error  between  lens  and  subcell, 
the  out  of  roundness  of  the  outside  diameter  of  the  subcell,  and  the  out  of 
roundness  of  the  inside  diameter  of  the  barrel  bore.24  Typically,  out  of  round¬ 
ness  is  controlled  during  classic  machining  operations  to  about  2.5  fxm.  If  the 
lens  is  centered  with  respect  to  the  outer  diameter  of  the  subcell  to  5  \xm,  a 
total  centering  error  of  10  jxm  is  obtained. 

Two  different  techniques  are  used  to  center  the  individual  lenses  with  re¬ 
spect  to  the  subcells.  In  the  first  technique,  the  lens  is  spun  into  a  metal  cell 
and  the  cell  outer  diameter  is  machined  concentric  with  the  optical  axis.  The 
second  technique  centers  the  lens  with  respect  to  the  subcell  using  mechanical 
and  optical  means,  and  then  bonds  the  lens  to  the  subcell.  Semiflexible  adhesive 
bonding  is  often  used  as  a  bonding  technique  to  isolate  the  lens  from  expansion 
or  contraction  of  the  cell.  A  vent  hole  must  be  provided  in  each  subcell  to 
permit  trapped  air  to  escape  as  the  subcell  is  pressed  into  the  barrel. 

Stress  is  induced  in  the  lens  when  the  subcell  is  pressed  into  the  main  barrel. 
If  the  lens  is  bonded  to  the  subcell  using  semiflexible  adhesive  bonding,  the 
stress  induced  in  the  lens  is  given  by  : 


_1_  / 8\  hB 

hr  \2/  hB  +  Hc 


(3.58) 


(3.59) 
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°G 


ErZr 

(1  +  Vr ) 


(3.60) 


where 

dG  =  stress  induced  in  the  lens 

Er  =  elastic  modulus  of  the  adhesive 
vr  =  Poisson’s  ratio  for  the  adhesive 
hr  =  adhesive  radial  thickness 
8  =  radial  interference  between  subcell  and  barrel 

hB  =  barrel  radial  thickness 

hc  =  subcell  radial  thickness 
Lc  -  subcell  axial  length 

Lb  =  effective  axial  length  of  the  barrel  (normally  taken  as  1.5  to  3 
times  the  subcell  axial  length). 

Figure  3.13  shows  a  subcell  barrel. 


3.5.3  Barrel  Sealing 

Barrels  should  be  sealed  to  prevent  the  entrance  of  foreign  matter.  Dust  and 
water  vapor  (which  can  cause  fogging  of  the  barrel  interior  with  a  temperature 
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drop)  should  be  excluded.  This  requires  hermetic  sealing  of  the  barrel.  Hermetic 
sealing  is  obtained  through  the  use  of  conventional  O-ring  seals  in  the  lens 
barrel  retainers.  O-rings  should  not  be  placed  in  a  seat  unless  precautions  are 
taken  to  ensure  full  compression.  If  the  O-ring  is  not  fully  compressed,  the 
lens  position  is  uncertain. 

Semiflexible  adhesive  mounting  of  the  lens  provides  an  acceptable  hermetic 
seal,  because  the  adhesive  extends  completely  around  the  circumference  of  the 
lens.  If  no  pressure  differential  is  expected  between  the  barrel  interior  and 
the  outside  environment,  a  relatively  simple  flat  gasket  can  be  used. 

If  the  barrel  is  exposed  to  pressure  changes,  it  is  desirable  to  provide  vents 
to  reduce  pressure  differentials.  Pressure  differentials  across  the  outer  (end) 
elements  of  the  barrel  can  move  the  elements  out  of  position  and  strain  the 
elements  out  of  shape.  If  a  vent  is  provided,  a  dust  filter  and  desiccant  are 
very  desirable  to  reduce  the  possibility  of  dust  or  water  vapor  entering  the 
barrel  interior. 

Pressurizing  the  interior  of  the  barrel  with  a  dry  gas  is  another  technique 
for  preventing  the  entry  of  foreign  contaminants  into  the  barrel.  Typically  dry 
nitrogen  or  dry  helium  is  used.  Both  gases  will  diffuse  through  the  barrel  seals 
requiring  periodic  purging  and  refilling. 

3.6  MIRROR  DESIGN  AND  MOUNTING 

Any  surface  error  on  a  mirror  is  magnified  by  a  factor  of  2  on  the  reflected 
wave  front.  For  this  reason,  mounting  stress  is  very  important  in  mirrors.  Self¬ 
weight  deflection  of  mirror  surfaces  is  a  problem  in  large  mirrors.  System 
constraints  often  require  lightweight  mirrors. 

To  minimize  deflection  due  to  self-weight  or  polishing  pressure  during  fab¬ 
rication,  mirrors  should  be  as  thick  as  possible.  The  traditional  rule  for  min¬ 
imum  thickness  in  right  circular  cylinder  mirrors  is  a  six-to-one  diameter  to 
thickness  or  aspect  ratio.  Much  thinner  mirrors  can  be  made,  but  the  fabri¬ 
cation  cost  increases  rapidly  with  an  increased  aspect  ratio.  The  sensitivity  of 
mirror  surfaces  to  deflection  requires  that  support  and  preload  forces  be  located 
so  as  to  minimize  bending. 

3.6.1  Self-Weight  Deflection  of  Mirrors 

Self-weight  deflection  of  mirror  surfaces  has  two  components:  axial  and  radial. 
Axial  deflection  occurs  when  the  mirror  is  on  its  back  with  the  optical  axis 
vertical.  Radial  deflection  occurs  when  the  mirror  is  on  its  edge,  with  its  optical 
axis  horizontal.  At  any  arbitrary  orientation,  radial  and  axial  deflection  are 
combined  to  find  the  resulting  surface  deflection  using  the  following  equation33: 

5m  =  [(8a  cos0)2  +  (8fl  sin0)2]^  ,  (3.61) 

where 

5m  =  self-weight  deflection  of  the  mirror 

0  =  angle  between  the  mirror  surface  optical  axis  and  local  vertical 

hA  =  axial  component  of  the  mirror  surface  deflection  (surface 
deflection  in  the  axis  vertical  position) 
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=  radial  component  of  the  mirror  surface  deflection  (surface 
deflection  in  the  axis  horizontal  position). 

Axial  self- weight  deflection  is  calculated  using  the  following  equation34: 


&A 


(1  -  V2)  =  Cs 


p  h  d 4 

Em>  ’ 


(3.62) 


where 

bA  -  axial  self-weight  mirror  surface  deflection 

Cs  -  a  support  condition  constant 

p  -  mirror  material  density 

E  =  modulus  of  elasticity  of  the  mirror  material 

d  =  mirror  diameter  (or  radius) 

h  =  mirror  thickness 

v  =  Poisson’s  ratio  for  the  mirror  material 

D  =  mirror  flexural  rigidity. 

Many  axial  mirror  mounts  consist  of  a  number  of  support  points  in  contact 
with  the  mirror  back.  The  simplest  multiple-point  axial  support  uses  three 
points  on  a  common  diameter.  To  produce  minimum  self- weight  deflection,  the 
support  diameter  should  be  0.645  of  the  mirror  diameter.  In  this  case,  the  axial 
self- weight  deflection  of  the  mirror  is  given  by35: 

4  j  4 

5a  =  0.318  Ifsd  -  V2)  =  0.0265  jr  ,  (3.63) 

Hi  h  Hj  U 


where  8A  is  the  maximum  axial  surface  deflection  and  r  is  the  mirror  me¬ 
chanical  radius. 

It  is  sometimes  more  convenient  to  provide  three  support  points  equally 
spaced  about  the  edge  of  the  mirror.  In  this  case,  the  axial  self- weight  deflection 
is  given  by: 

=  0.412 1^(1  -  V2)  =  0.0344^  .  (3.64) 


Equations  (3.63)  and  (3.64)  differ  only  in  the  value  of  the  support  condition 
constant  and  are  variations  of  Eq.  (3.62).  A  very  similar  approach  is  used  to 
calculate  the  axial  self-weight  deflection  of  a  rectangular  mirror.  A  common 
three-point  axial  support  for  a  rectangular  mirror  places  one  support  point  at 
the  middle  of  one  of  the  long  edges,  and  the  remaining  two  support  points  at 
the  corners  of  the  opposite  long  edge.  If  supported  this  way,  the  self-weight 
deflection  of  a  rectangular  mirror  is  given  by36: 


*  _  12  pL4  _  2 

C  E  h2(1  V 


(3.65) 


7  (Lib) 

{1  +  [0.461(L/5)]13}Vl3  ’ 


(3.66) 
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where  L  is  the  length  of  the  long  edge  of  the  mirror  and  b  is  the  length  of  the 
short  edge  of  the  mirror. 

Simple  three-point  axial  mirror  supports  provide  acceptable  support  for  sys¬ 
tems  requiring  "diffraction-limited”  performance  in  the  visible,  if  the  mirror 
is  small  (below  0.2  m  in  diameter)  and  stiff  (solid,  with  a  six-to-one  aspect 
ratio).  Larger  mirrors,  or  mirrors  with  low  stiffness,  require  more  complex 
support.  Typically,  a  multipoint  support  scheme  is  used  for  large  optics.  The 
number  of  support  points  required  is  given  by37: 


1.5r2  /  p  l\ 


(3.67) 


where  N  is  the  number  of  support  points  required  and  8  is  the  required  max¬ 
imum  self-weight  deflection  of  the  mirror  surface. 

Details  on  complex  multiple-point  axial  support  systems  are  found  in  the 
literature  and  are  outside  the  scope  of  this  chapter.38  Normally,  IR  systems 
do  not  require  mirror  supports  of  this  complexity.  One  multiple-point  support 
scheme  that  is  not  difficult  to  implement  uses  six-point  supports  equally  spaced 
on  a  common  diameter  that  is  0.681  of  the  mirror  diameter.  Self-weight  de¬ 
flection  of  a  mirror  on  a  six-point  support  of  this  type  is  given  by: 

bA  =  0.0414  £4(1  -  v2)  =  0.00345^  .  (3.68) 

A  Eh2  ED 


When  the  mirror  is  on  its  edge,  with  its  optical  axis  horizontal,  the  radial 
component  of  the  self- weight  deflection  of  the  mirror  surface  is  calculated  using 
an  approach  developed  by  Schwesinger39: 


7  = 


2  KR  ’ 


o  2pr^ 

hR  =(a0  +  ary  +  a2 7  )“^r 


(3.69) 

(3.70) 


where 

8#  -  rms  mirror  surface  deflection 
R  -  mirror  surface  optical  radius  of  curvature 

r  =  mirror  semidiameter 

h  =  mirror  axial  thickness 

7  =  mirror  thickness  variation  parameter, 

and  ao,  01,  and  a2  are  support  condition  constants. 

Table  3.6  provides  support  condition  constants  for  a  variety  of  radial  sup¬ 
ports.  Many  common  radial  supports  for  mirrors  use  two  support  points  located 
below  the  mirror.  Radial  surface  deformation  is  at  a  minimum  for  a  two-point 
support  if  the  points  are  located  90  deg  apart,  and  equally  spaced  with  respect 
to  local  vertical.40  In  addition,  for  minimum  surface  deflection,  friction  between 
the  two  support  points  and  the  mirror  edge  should  be  as  low  as  possible. 
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Table  3.6  Schwesinger  Equation  Constants 


Support 

«o 

fli 

°2 

One  point  at  0  deg 

0.06654 

0.7894 

■m 

Two  points  at  45  deg 

0.05466 

0.2786 

Two  points  at  60  deg 

0.09342 

0.7992 

■SKi 

180  deg  sling 

0.00074 

0.1067 

0.0308 

Astigmatism  is  induced  in  the  mirror  optical  surface  if  the  two  support  points 
are  not  placed  in  the  same  plane  as  the  mirror’s  center  of  gravity.  For  minimum 
radial  self-weight  deflection,  one  of  the  best  supports  is  a  simple  sling  or  band 
wrapped  around  the  lower  180  deg  of  the  mirror.41 

3.6.2  Lightweight  Mirrors 

Conventional  solid-glass  right  circular  cylinder  mirrors  are  relatively  heavy, 
with  a  weight  given  by42: 

W  =  24 6D292  ,  (3.71) 

where  W  is  the  mirror  weight  in  kilograms  and  D  is  the  mirror  diameter  in 
meters.  For  many  applications,  such  as  satellite  systems,  a  mirror  with  a 
weight  given  by  Eq.  (3.71)  is  unacceptably  heavy.  Pointing  and  tracking  sys¬ 
tems  are  often  relatively  limited  in  drive  torque,  requiring  the  use  of  low 
moment  of  inertia  and,  hence,  lightweight  mirrors.  The  thermal  inertia  of  solid 
mirrors  may  be  excessive,  requiring  a  lightweight  mirror  design.  Lightweight 
mirrors  are  usually  much  more  expensive  to  fabricate  than  conventional  solid 
mirrors  and  are  difficult  to  mount. 

Conventional  lightweight  mirrors  have  about  30  to  40%  of  the  weight  of 
the  same  diameter  solid  six-to-one  aspect  ratio  mirror.  The  weight  of  these 
mirrors  is  estimated  by: 

W  =  120D2-82  ,  (3.72) 

where  W  is  the  mirror  weight  in  kilograms  and  D  is  the  mirror  diameter  in 
meters. 

State-of-the-art  lightweight  mirrors  have  about  20%  of  the  weight  of  the 
same  diameter  solid  six-to-one  aspect  ratio  mirror.  The  weight  of  these  mirrors 
is  estimated  by: 

W  =  53D2'67  ,  (3.73) 

where  W  is  the  mirror  weight  in  kilograms  and  D  is  the  mirror  diameter  in 
meters.  Figure  3.14  compares  mirror  weight  as  a  function  of  diameter  for 
lightweight  and  solid  mirrors. 

A  useful  parameter  in  evaluating  performance  of  a  lightweight  mirror  is 
the  ratio  of  the  self-weight  deflection  of  the  lightweight  mirror  to  the  self¬ 
weight  deflection  of  a  solid  mirror  of  the  same  diameter.  If  this  ratio  exceeds 


160  IR/EO  HANDBOOK 


Fig.  3.14  Mirror  weight  as  a  function  of  diameter  for  traditional,  lightweight,  and  ultra- 
lightweight  mirrors. 


unity,  the  lightweight  mirror  has  less  stiffness  than  the  conventional  solid 
mirror.  A  lightweight  mirror  that  is  not  as  stiff  as  a  solid  mirror  of  the  same 
weight  has  very  limited  utility.  More  common,  but  less  useful  performance 
parameters  for  lightweight  mirrors  are  the  area  density,  and  also  weight  in 
terms  of  percentage  of  an  equivalent  diameter  six-to-one  aspect  ratio  solid.43 

Contoured  Back  Mirrors.  Contouring  the  back  of  a  lightweight  mirror  reduces 
the  weight  and  improves  the  stiffness-to- weight  ratio  of  the  mirror.  Three  types 
of  mirror  back  contour  are  used:  the  single  arch,  the  double  arch,  and  the 
symmetric  shape.  A  contoured  back  mirror  of  optimum  design  can  have  a 
deflection  ratio  of  0.50  or  less  when  compared  to  a  solid  mirror  of  the  same 
weight.44 

The  simplest  type  of  contoured  back  mirror  is  produced  by  tapering  the  back 
of  the  mirror  from  a  thick  hub  to  a  thin  edge.  A  straight  taper  is  easiest  to 
produce.  Self-weight  deflection  for  a  single-tapered  mirror  is  obtained  by  a 
parabolic  taper  on  the  back  of  the  mirror,  with  the  vertex  of  the  parabola 
coincident  with  the  back  of  the  mirror.  If  a  parabolic  taper  is  used,  this  type 
of  contoured  back  mirror  is  called  a  single-arch  mirror.  Deflection  efficiency 
of  the  single  arch  is  poor,  with  a  deflection  ratio  of  about  2  when  compared 
with  a  solid  mirror  of  the  same  weight.  Weight  of  a  single-arch  mirror  can  be 
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Fig.  3.15  Contoured  back  mirrors:  (a)  single  arch,  (b)  double  arch,  and  (c)  double  concave. 


reduced  to  about  40%  of  the  same  diameter  solid.  Simplicity  is  the  main  virtue 
of  the  single-arch  mirror.  A  single-arch  mirror  is  normally  mounted  using  a 
central  hub  mount.  Since  the  weight  of  the  mirror  mount  is  very  low,  good 
efficiency  is  possible  when  the  weight  of  the  single  arch  and  its  mount  is 
compared  to  the  weight  of  a  conventional  solid  mirror  and  mount. 

A  double  parabolic  taper  is  used  in  the  double-arch  mirror.  The  thickest 
portion  of  the  mirror  is  a  ring  located  at  the  0.5  to  0.7  point  of  the  mirror 
diameter.  Mirror  thickness  is  reduced  using  a  parabolic  taper  from  this  ring 
toward  a  thin  edge.  Mirror  thickness  is  also  reduced  using  a  parabolic  taper 
from  this  ring  toward  the  center,  so  that  the  center  and  edge  of  the  mirror  are 
both  equally  thin.  Both  parabolic  tapers  have  vertices  located  at  the  back  of 
the  mirror.  The  self-weight  deflection  of  a  double-arch  mirror  is  about  0.25  of 
a  solid  mirror  of  the  same  aspect  ratio  and  about  0.16  that  of  a  solid  mirror 
of  the  same  weight.  Weight  of  double-arch  mirrors  can  be  reduced  to  about 
30%  of  the  same  diameter  solid  mirror.  Mounting  of  the  double-arch  mirror  is 
more  complex  than  that  of  a  single-arch  mirror,  and  requires  the  use  of  three 
or  more  support  sockets  in  the  back  of  the  mirror. 

If  the  mirror  is  intended  for  use  in  the  axis  horizontal  position,  a  symmetric 
shape  has  the  advantage  of  minimum  self-weight  deflection.  Symmetric  double 
convex  or  double  concave  mirrors  have  very  small  radial  components  of  de¬ 
flection  in  the  one  edge  position.  When  used  in  the  axis  vertical  position,  the 
symmetric  shape  produces  excessive  self-weight  deflection. 

Contoured  back  mirror  shapes  are  shown  in  Fig.  3.15. 
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Rib-Reinforced  Lightweight  Mirrors.  A  rib-reinforced  lightweight  mirror  con¬ 
sists  of  a  thin  faceplate  with  a  regular  array  of  ribs  attached  to  the  back  of 
the  faceplate.  The  regular  array  of  intersecting  reinforcing  ribs  forms  repeating 
pockets  or  cells  in  the  back  of  the  mirror.  This  type  of  mirror  is  called  an  open- 
back  mirror.  If  a  second  plate  is  attached  to  the  back  of  the  array  of  ribs,  a 
sandwich  structure  is  developed.  This  type  of  mirror,  with  two  plates  connected 
by  an  array  of  ribs,  is  called  a  sandwich  mirror. 

Although  complex  in  structure,  the  self-weight  deflection  of  either  open- 
back  or  sandwich  mirrors  can  be  calculated  by  reducing  the  stiffness  of  the 
mirror  to  that  of  an  equivalent  solid  mirror.  This  equivalent  stiffness  is  the 
equivalent  flexural  rigidity  of  the  mirror.  For  an  open-back  mirror,  the  equiv¬ 
alent  flexural  rigidity  is  given  by45: 


_  (2 B  4*  tc)tc 
11  =  (B  +  tcf  ’ 

,  {[1  -  (V2 )][h4p  -  (r\hp2)]  +  (hF  +  W4(V 2}} 

he  ~  [hF  +  (x|2hc/2)] 

D  12(1 -v2)  ’ 


(3.74) 

(3.75) 

(3.76) 


where 

D  =  equivalent  flexural  rigidity  of  the  mirror 
hB  =  equivalent  bending  thickness 
hF  =  faceplate  thickness 

E  =  modulus  of  elasticity  of  the  mirror  material 
v  =  Poisson’s  ratio  for  the  mirror  material 

B  =  cell  inscribed  circle  diameter  ( B  =  0.5774a  for  a  triangular  cell, 
B  =  a  for  a  square  cell,  B  =  1.732a  for  a  hexagonal  cell) 
a  =  length  of  the  cell  sides 
i)  =  rib  solidity  ratio 
tc  =  cell  wall  thickness 
hc  -  rib  height. 

The  weight  of  an  open-back  mirror  is  given  by: 


W  =^p d\hF  +  y\hc)  y 


(3.77) 


where 

W  =  mirror  weight 
d  -  mirror  diameter 
p  =  mirror  material  density. 

Similar  methods  are  used  to  find  the  equivalent  flexural  rigidity  of  a  sandwich 
mirror.  A  sandwich  mirror  employs  a  faceplate  and  a  backplate,  connected  by 
an  array  of  intersecting  ribs  forming  a  repeating  pattern  of  cells  inside  the 
mirror.  The  equivalent  flexural  rigidity  of  a  sandwich  mirror  is  given  by: 
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hB  =  (2  hF  +  hc)3 


(3.78) 


D  = _ — 

12(1  -  v2) 


(3.79) 


where  hF  is  the  face  plate  thickness  (the  backplate  is  assumed  to  have  the 
same  thickness)  and  hB  is  the  equivalent  thickness  of  the  mirror. 

The  weight  of  a  sandwich  mirror  is  given  by: 


W  =  ^  pd2(2hF  +  T| he)  .  (3.80) 

There  is  an  optimum  relationship  between  faceplate  thickness,  rib  thickness, 
and  cell  size  for  minimum  self- weight  deflection.  Figures  3.16  and  3.17  relate 
these  parameters  for  an  open-back  mirror  and  a  sandwich  mirror,  respectively. 
Some  caution  is  indicated  in  employing  these  figures,  due  to  a  fabrication  issue 
involving  mirror  surface  deformation  corresponding  to  the  structure  of  the 
ribs.  During  fabrication,  the  mirror  faceplate  will  deflect  between  ribs  due  to 
polishing  pressure.  This  deflection,  called  quilting  (because  the  periodic  pattern 
of  deflection  resembles  the  square  of  a  quilt),  is  permanently  polished  into  the 
mirror  surface  figure.  Quilting  causes  a  reduction  in  energy  in  the  central 
maximum  of  the  diffraction  disk.  Reduction  of  quilting  is  possible  by  increasing 
the  faceplate  thickness,  decreasing  the  spacing  between  ribs,  or  by  using  lighter 
polishing  pressures.  Figure  3.18  gives  the  representative  quilting  for  different 
types  of  cells. 


Fig.  3.16  Open  back  mirror  flexural  rigidity. 
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3.6.3  Metal  Mirrors 

Mirrors  made  of  metal  are  a  common  feature  of  many  IR  systems.46  Beryllium 
and  aluminum  are  the  most  common  metal  mirror  materials.  Copper  and 
molybdenum  are  used  in  high-energy  laser  mirror  applications.  Interest  is 
growing  in  the  metal  matrix  composites,  most  notably  the  aluminum/silicon 
carbide  reinforced  materials.  Metal  mirrors  have  the  following  advantages: 

1.  Ease  of  fabrication:  Metal  mirrors  are  fabricated  using  nontraditional 
methods  such  as  casting,  machining,  and  diamond  turning.  This  ease 
of  fabrication  makes  it  possible  to  utilize  surface  shapes  such  as  off- 
axis  aspherics,  which  would  be  very  difficult  to  fabricate  in  glass  using 
traditional  optical  shop  methods. 

2.  Ease  of  mounting:  It  is  possible  to  produce  threaded  holes  in  metal 
mirrors  and  to  use  these  holes  for  mounting.  Integral  mounts  can  be 
combined  into  some  mirror  configurations. 

3.  Thermal  stability:  The  thermal  conductivity  of  metals  used  in  mirrors 
is  much  higher  than  that  of  glass  mirror  materials.  Metal  mirrors 
reach  thermal  equilibrium  faster  than  glass  mirrors  and  have  good 
resistance  to  thermal  distortion  due  to  temperature  gradients. 

4.  Athermalization:  By  making  the  mirrors  and  support  structure  out  of 
a  single  metal,  the  system  alignment  and  focus  are  maintained  over 
a  wide  range  of  temperatures. 

5.  Specific  stiffness:  The  stiffness-to-weight  ratio  of  certain  metals,  no¬ 
tably  beryllium,  is  much  better  than  that  of  traditional  optical  ma¬ 
terials.  Use  of  high  stiffness-to-weight  ratio  metals  allows  reduction 
in  mirror  weight. 

6.  Nuclear  hardness:  Certain  metals,  notably  beryllium,  are  resistant  to 
damage  when  exposed  to  high  nuclear  radiation  fluxes. 

Metal  mirrors  have  significant  disadvantages: 

1.  Long-term  stability:  Metals  exhibit  dimensional  instability.  The  op¬ 
tical  surface  figure  of  metal  mirrors  changes  with  time. 

2.  Surface  scatter:  Scatter  from  a  bare  metal  mirror  surface  is  excessive 
for  some  applications. 

3.  Bimetallic  bending:  Surface  scatter  from  a  bare  metal  mirror  surface 
is  reduced  by  plating  the  mirror  with  electroless  nickel.  The  thermal 
coefficient  of  expansion  of  electroless  nickel  is  different  from  the  ther¬ 
mal  coefficients  of  expansion  of  either  aluminum  or  beryllium  (the 
two  most  common  metal  mirror  materials).  This  difference  in  thermal 
coefficient  of  expansion  can  cause  the  metal  mirror  surface  to  deform 
as  the  temperature  changes  and  induces  stress  in  the  mirror. 

4.  Corrosion:  Metals  are  electrochemically  active  and  are  vulnerable  to 
corrosion  in  certain  service  environments. 

Dimensional  stability  is  a  major  concern  in  metal  mirrors.  Changes  in  the 
optical  figure  of  metal  mirrors  amounting  to  one  wave  per  year  (1  wave  = 
633  nm)  are  well  documented.47  Cyclic  temperature  changes  or  stress  induced 
by  mounting  can  also  cause  permanent  deformations  in  the  mirror  surface.48 
The  three  basic  causes  of  dimensional  instability  of  metal  mirrors  are  metal¬ 
lurgical  instability,  microcreep  under  load,  and  release  of  residual  stress. 
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Metallurgical  stability  is  a  complex  subject  whose  origins  are  outside  the 
scope  of  this  chapter.49  Certain  metals  exhibit  worse  stability  than  others.  For 
example,  Invar  has  a  stability  of  about  one  to  two  parts  per  million  per  year,50 
while  the  stainless  steel  17-4  PH  has  a  stability  of  about  1  part  in  10  million 
per  year.51  Long-term  stability  is  best  assessed  from  experience  52  As  a  rough 
rule  of  thumb,  the  higher  the  transition  temperature  or  melting  temperature 
of  the  material,  the  better  the  stability. 

Andrade's  beta  law  is  often  used  to  predict  dimensional  change  in  materials. 
Although  no  absolute  proof  of  the  applicability  of  this  law  to  all  materials 
exists,  it  has  proven  reliable  for  the  metals  commonly  used  in  mirrors.53  Andrade's 
beta  law  states  that  the  change  in  physical  size  with  time  of  a  metal  is  pro¬ 
portional  to  the  time  raised  to  a  power.  This  power  is  typically  about  0.33,  or: 

s  =  ,  (3.81) 

where 

e  =  creep  strain  at  some  time 

P  =  a  constant  depending  on  material,  stress,  and  temperature 

t  —  time 

m  -  time  dependent  constant  (this  is  usually  about  0.33,  with  a  range 
of  0.26  to  0.39). 

Determining  the  amount  of  microcreep  that  may  occur  under  load  is  difficult. 
It  is  possible  to  determine  the  microyield  properties  of  the  material.  Microyield 
is  defined  as  a  permanent  plastic  deformation  in  the  metal  that  occurs  at  a 
stress  below  the  yield  stress  of  the  material.  Microyield  strength  is  defined  as 
the  amount  of  stress  required  to  produce  a  permanent  plastic  deformation  in 
the  material  of  one  part  per  million.  Microyield  strength  (MYS)  is  also  known 
as  the  precision  elastic  limit  (PEL)  of  the  material.  A  common  practice  in 
designing  metal  optics  is  to  limit  all  stresses  below  the  microyield  strength  of 
the  material.  This  practice  attempts  to  limit  optical  surface  deformation  due 
to  dimensional  instability.  For  certain  metals  in  the  strain  range  of  10" 7  to 
10  "4,  the  following  equation  is  used  to  predict  microyield  behavior54: 

a  =  Ken  ,  (3.82) 

where 

a  =  applied  stress 

K  ~  microstrain  hardening  coefficient 

n  =  microstrain  hardening  exponent 

e  =  permanent  strain. 

Residual  stress  release  in  metal  mirrors  over  time  is  another  source  of  di¬ 
mensional  instability.55  Residual  stress  release  is  reduced  by  using  low  resid¬ 
ual  stress  fabrication  processes  and  by  heat  treatment  after  fabrication.  Stan¬ 
dard  simple  stress  relieving  heat  treatments  are  insufficient  for  optimum  stability 
of  metal  mirrors.  Special  cyclic  heat  treatments  are  necessary  for  optimum 
stability.56  Table  3.7  gives  stabilizing  heat  treatments  for  aluminum,  beryl¬ 
lium,  and  metal  matrix  composites. 
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Table  3.7  Some  Suggested  Stabilization  Heat  Treatments  for  Metal  Mirrors 


1.  Aluminum  (6061-T6) 

a.  Heat  parts  in  furnace  to  375°F  ±  10°F.  Hold  for  3  h.  Furnace  or  still  air  cool  to 
room  temperature.  Chill  to  -40°F  for  0.5  h.  Warm  to  room  temperature. 
Temperature  change  not  to  exceed  15°F  per  minute. 

b.  Repeat  step  (a). 

c.  Heat  to  325°F  for  1  h.  Still  air  cool  to  room  temperature. 

2.  Beryllium 

a.  Reduce  temperature  to  80  K  ±  10  K.  Hold  for  0.5  h.  Warm  to  room  temperature. 
Temperature  change  not  to  exceed  100  K  per  hour. 

b.  Hold  at  room  temperature  for  0.5  h. 

c.  Raise  temperature  to  373  K.  Hold  for  0.5  h.  Cool  to  room  temperature. 

d.  Hold  at  room  temperature  for  0.5  h. 

e.  Repeat  steps  (a)  through  (d). 

Note:  Mirror  is  maintained  in  a  dry  atmosphere  to  eliminate  condensation  during 
heat  treatment. 

3.  Aluminum/silicon  carbide  reinforced  metal  matrix  composite 

a.  Cool  to  -75°F  ±  10°F.  Hold  for  1  h.  Temperature  change  not  to  exceed  5°F  per 
minute.  Do  not  quench  mirror. 

b.  Warm  to  212°F.  Hold  for  1  h. 

c.  Cool  to  room  temperature. 

d.  Repeat  steps  (a)  through  (c)  for  a  total  of  five  cycles. 


The  most  common  metal  mirror  material  is  aluminum.  Type  6061-T6  alu¬ 
minum  alloy  is  the  most  common  aluminum  used  for  metal  mirrors.  Type  6061 
aluminum  is  inexpensive,  has  well-established  properties,  and  has  good  di¬ 
mensional  stability.  Diamond  turning  can  be  used  with  6061  aluminum  to 
produce  mirror  surfaces.  Metallurgical  impurities  in  6061  cause  relatively 
rapid  wear  in  diamond  tools  during  the  diamond-turning  process.  To  avoid  this 
wear,  the  50  series  aluminum  alloys  are  sometimes  used.  The  50  series  alloys 
are  available  in  higher  purity  and  give  better  tool  life  in  diamond-turning 
operations.  Unfortunately,  the  long-term  stability  of  the  50  series  alloys  is  less 
than  that  of  the  60  series.57 

Beryllium  is  an  exotic  metal  that  offers  a  stiffness-to- weight  ratio  about  6.5 
times  greater  than  that  of  aluminum.  Beryllium  has  a  thermal  coefficient  of 
expansion  about  half  that  of  aluminum  with  comparable  thermal  conductivity. 
These  very  attractive  properties  are  at  least  partially  offset  by  controversial 
long-term  dimensional  stability  and  by  the  high  cost  of  beryllium. 

Beryllium  is  a  highly  anisotropic  metal.  This  anisotropy  is  overcome  by  the 
use  of  powder  metallurgy,  by  using  such  techniques  as  hot  isotropic  pressing 
to  produce  mirrors.  Residual  anisotropy  of  beryllium  is  at  least  partially  re¬ 
sponsible  for  the  controversial  performance  of  this  material.58 

Beryllium  is  a  toxic  material.  Toxicity  is  an  issue  if  beryllium  dust  is  inhaled 
into  the  lungs.  There  is  no  hazard  associated  with  handling  or  using  beryllium 
metal,  so  long  as  no  beryllium  particulate  is  produced.  Appropriate  care  during 
fabrication  operations  reduces  risk  due  to  the  toxicity  of  beryllium  to  a  very 
low  level.  Toxicity  and  the  requisite  handling  precautions  are  partially  re¬ 
sponsible  for  the  high  cost  of  beryllium. 

The  metal  matrix  composites  (MMC),  notably  the  aluminum/silicon  carbide 
reinforced  materials,  have  considerable  promise  for  use  in  IR  systems.59 
Aluminum/silicon  carbide  composites  can  be  tailored  to  have  a  specific  stiffness 
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about  1.6  times  greater  than  aluminum.  The  thermal  coefficient  of  expansion 
of  the  MMC  materials  can  be  tailored  to  match  exactly  that  of  electroless  nickel 
plating,  therefore  eliminating  a  cause  of  thermal  distortion  in  metal  mirrors. 
Initial  studies  of  MMC  materials  indicate  that  these  materials  have  higher 
microyield  strengths  than  either  beryllium  or  aluminum.  The  cost  of  the  MMC 
materials  is  higher  than  aluminum,  but  may  be  competitive  with  beryllium. 

3.6.4  Thermal  Effects  on  Mirrors 

Changes  in  temperature,  or  temperature  gradients,  can  cause  changes  in  the 
optical  surface  figures  of  mirrors.  Since  IR  systems  are  often  used  over  wide 
temperature  ranges,  evaluation  of  temperature  effects  on  mirrors  is  an  im¬ 
portant  topic. 

General  Effects  of  Temperature  on  Mirrors.  If  the  mirror  is  exposed  to  an 
overall  change  in  temperature,  and  to  linear  temperature  gradients  in  each 
axis  of  a  Cartesian  coordinate  system  centered  at  the  mirror  optical  surface 
vertex,  with  the  temperature  distribution  of  the  form60: 

T(x,y,z )  =  Co  +  Ci(x)  +  C2(y)  +  C3(z)  ,  (3-83) 

where  T(x,y,z)  is  the  temperature  distribution,  CD  is  the  overall  mirror  tem¬ 
perature,  and  Ci,  C2,  and  C3  are  the  linear  temperature  gradients,  in  each 
axis  ( x,y,z ). 

Mirror  distortion  caused  by  the  preceding  temperature  distribution  is  given  by: 
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where 


8(r,0)  =  mirror  surface  deformation 

r  =  radial  position  on  the  mirror  surface 

0  =  angular  position  on  the  mirror  surface 

ot  =  thermal  coefficient  of  expansion  of  the  mirror  material 

R  =  optical  surface  radius  of  curvature 

h  =  axial  thickness  of  the  mirror 

Ca,  C 5  =  constants  defining  the  tilt  of  the  mirror 

Ce  =  a  constant  defining  the  axial  position  of  the  mirror  surface. 
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The  mirror  surface  radius  of  curvature  changes  if  the  mirror  is  exposed  to  a 
steady-state  linear  axial  thermal  gradient.  Change  in  the  radius  of  curvature 
is  given  by: 


_1_  _  J.  =  a 

Ro  R  ~  Kq  ’ 


(3.85) 


where 

R  =  original  radius  of  curvature 

Ro  =  radius  of  curvature  of  the  thermally  distorted  mirror 
K  ~  thermal  conductivity  of  the  mirror  material 
q  =  heat  flux  absorbed  per  unit  area. 

In  Eq.  (3.85)  the  material  parameter  determining  mirror  deformation  is  the 
ratio  of  thermal  coefficient  of  expansion  to  thermal  conductivity.  This  ratio  is 
called  the  thermal  distortion  parameter  of  the  material.  The  thermal  distortion 
parameter  is  often  used  to  select  materials  for  use  in  applications  where  there 
is  a  thermal  gradient.  Metals  have  better  thermal  distortion  parameters  than 
ordinary  glasses.  For  example,  aluminum  has  a  thermal  distortion  parameter 
of  136  x  10" 9  m/W,  while  a  borosilicate  glass  has  a  thermal  distortion  pa¬ 
rameter  of  2.9  x  10"6m/W. 

It  is  often  of  interest  to  determine  how  rapidly  a  mirror  will  reach  thermal 
equilibrium  following  a  temperature  change.  The  time  required  for  an  optical 
element  to  reach  thermal  equilibrium  is  controlled  by  the  material  property 
of  thermal  diffusivity.  The  thermal  diffusivity  of  a  material  is  given  by: 


a 


K 

pCP  ’ 


(3.86) 


where 

a  =  thermal  diffusivity 
p  =  material  density 
K  =  material  thermal  conductivity 
Cp  =  material  specific  heat. 

Heat  transfer  in  mirrors  is  a  complex  subject  that  is  beyond  the  scope  of 
this  discussion.  A  simple  approximation  is  often  useful  to  determine  the  rate 
at  which  the  mirror  changes  temperature.  If  only  one  side  of  the  mirror  trans¬ 
fers  heat,  and  if  there  is  no  transfer  at  the  edge  of  the  mirror,  the  interior 
temperature  of  the  mirror  after  some  time  is  given  by: 


where 

T  -  initial  mirror  temperature 

T'  =  mirror  temperature  following  a  sudden  temperature  change  after 
time  t 

h  =  mirror  thickness. 
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Effects  of  Spatial  Variation  of  Thermal  Coefficient  of  Expansion  of  Mirror 
Materials.  Most  mirror  materials  have  a  spatial  variation  of  thermal  coef¬ 
ficient  of  expansion.  A  spatial  variation  of  thermal  coefficient  of  expansion  in 
the  mirror  material  causes  the  mirror  surface  to  distort  as  the  temperature 
changes.  For  example,  in  a  right  circular  cylinder  mirror,  a  spatial  variation 
of  thermal  coefficient  of  expansion  from  center  to  edge  will  cause  a  change  in 
mirror  radius  of  curvature  as  the  temperature  is  changed.  As  a  rule  of  thumb, 
mirror  materials  have  a  spatial  variation  in  thermal  coefficient  of  expansion 
of  about  3%.  This  implies  that  low  thermal  coefficient  of  expansion  materials 
are  less  affected  by  this  variation  than  high  thermal  coefficient  of  expansion 
materials.  Table  3.8  gives  values  of  the  spatial  variation  of  thermal  coefficient 
for  materials. 

If  there  is  a  linear  variation  in  thermal  coefficient  of  expansion  through  the 
axial  thickness  of  the  mirror,  the  change  in  mirror  figure  with  temperature 
is  given  by: 

8  as  £-AaA  T  ,  (3.88) 

zn 

where 

8  =  change  in  mirror  optical  surface  figure 

Aa  =  total  change  in  thermal  coefficient  of  expansion,  through  the 
axial  thickness  of  the  mirror 
A  T  -  temperature  change 
h  =  mirror  axial  thickness 
r  =  mirror  mechanical  radius. 

Astigmatism  is  caused  in  the  mirror  optical  surface  figure  if  the  thermal 
coefficient  of  expansion  is  different  in  one  direction  in  the  plane  of  the  mirror. 


Table  3.8  Spatial  Variation  in  Thermal  Coefficient  of  Expansion  for  Various 

Mirror  Materials 


a  Homogeneity 

Material 

0(300  K) 

l(r6/K 

Aaooo  K) 
1CT9/K 

1.  Aluminum  (6061-T6) 

23.0 

60 

2.  Beryllium  (VHP  I-70A) 

11.5 

130 

3.  Beryllium  (HIP  I-70A) 

11.5 

30 

4.  Borosilicate  (Schott  Duran) 

3.2 

30 

5.  Borosilicate  (Ohara  E-6) 

3.0 

50 

6.  Fused  quartz  (Heraeus 

Amersil  T08E) 

0.50 

5 

7.  Fused  silica  (Corning  7940) 

0.56 

2.0 

8.  ULE  (Corning  7971) 

0.03 

4.0 

9.  Glass  ceramic  (Schott  Zerodur) 

0.05 

40 

10.  Glass  ceramic  (Cervit  C-101) 

0.03 

15 
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The  amount  of  optical  surface  deflection  caused  by  this  spatial  variation  in 
thermal  coefficient  of  expansion  is  given  by: 

h  =  ^{ax-  *y)\T  ,  (3.89) 

where  a*  is  the  thermal  coefficient  of  expansion  in  the  x  direction  of  the  mirror 
surface  plane  and  ay  is  the  thermal  coefficient  of  expansion  in  the  y  direction 
of  the  mirror  surface  plane. 

Bimetallic  Bending  Effects  in  Metal  Mirrors.  Metal  mirrors  are  plated  with 
electroless  nickel  to  reduce  surface  scatter  and  to  enhance  surface  reflection. 
Electroless  nickel  has  a  different  thermal  coefficient  of  expansion,  13  x  10“ 6 
m/m  K,  than  either  aluminum,  23  x  10“ 6  m/m  K,  or  beryllium,  11.2  x  10“ 6 
m/m  K  (see  Ref.  61).  The  difference  in  thermal  coefficient  of  expansion  causes 
a  bimetallic  bending  in  the  mirror  surface  when  the  plated  mirror  temperature 
is  changed.  If  the  mirror  temperature  is  changed  uniformly,  so  that  there  are 
no  temperature  gradients,  and  if  both  sides  of  the  mirror  are  plated,  the  re¬ 
sulting  optical  surface  deflection  and  mirror  stresses  are  given  by61: 
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where 


Ro 

R 


h 

hp\,  hp2  — 
a  m 

Oip  = 


original  mirror  surface  radius  of  curvature 

mirror  surface  radius  of  curvature  after  the  temperature 

change 

mirror  axial  thickness 

plating  thicknesses  on  the  front  and  back  of  the  mirror 
mirror  material  thermal  coefficient  of  expansion 
plating  material  thermal  coefficient  of  expansion 
plating  material  elastic  modulus 
mirror  material  elastic  modulus 
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Vm 

vp 
A  T 

O’rm 

0>p 


^P 

'I'm 


=  Poisson’s  ratio  for  the  mirror  material 
=  Poisson’s  ratio  for  the  plating  material 
=  temperature  change 

=  temperature-induced  radial  stress  in  the  mirror  surface 
=  temperature-induced  radial  stress  in  the  mirror  plating 
material 

=  plating  material  parameter 
=  mirror  material  parameter. 


Surface  deflection  of  the  plated  mirror  is  eliminated  by  making  the  plating 
thickness  on  the  front  and  back  of  the  mirror  equal.  Although  equal  plating 
thickness  eliminates  surface  distortion  as  the  mirror  temperature  is  changed, 
stress  is  still  induced  in  the  mirror  and  plating.  Radial  stress  in  the  mirror 
may  cause  a  change  in  mirror  optical  surface  figure  if  the  stress  exceeds  the 
microyield  strength  of  the  mirror  material.  Mirror  stress  is  reduced  by  in¬ 
creasing  mirror  thickness. 

A  similar  set  of  equations  is  used  to  determine  the  change  in  the  mirror 
optical  surface  figure  when  the  plated  mirror  is  exposed  to  a  steady-state 
temperature  gradient: 


_1_  _  1 
R0  R 


oimq 
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=  -^2-  ,  (3.99) 

1  -  Vm 

where 

R  =  mirror  surface  radius  of  curvature  after  the  mirror  is  exposed 
to  an  axial  heat  flux 

Km  -  mirror  material  thermal  conductivity 
q  =  axial  heat  flux  per  unit  area  absorbed  by  the  mirror 
hp  =  plating  thickness 
h  =  mirror  thickness 

( Trm  =  radial  stress  in  the  mirror  induced  by  the  axial  heat  flux 
c jrp  =  radial  stress  in  the  plating  induced  by  the  axial  heat  flux 


3.6.5  Mirror  Mounting 

Kinematic  Mirror  Mounts.  Mirror  mounts  are  designed  using  kinematic  prin¬ 
ciples.  According  to  kinematic  theory,  any  rigid  body  has  6  -  N  degrees  of 
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freedom,  where  N  is  the  number  of  points  in  contact  with  the  body.  Design  of 
a  mirror  mount  involves  selecting  the  number  and  location  of  the  N  contact 
points.  Any  mirror  that  is  contacted  by  more  than  six  contact  points  is  said  to 
be  overconstrained.  An  overconstrained  mirror  is  likely  to  be  distorted  and 
uncertain  in  position. 

Circular  mirrors  are  normally  not  sensitive  to  rotation  of  the  mirror  about 
its  optical  axis.  Since  rotation  of  the  mirror  about  the  optical  axis  does  not 
have  to  be  constrained,  a  kinematic  mount  for  a  circular  mirror  will  use  five 
contact  points.  The  classic  form  of  a  five-point  kinematic  mount  for  a  mirror 
consists  of  three  contact  points  against  the  back  of  the  mirror  and  two  contact 
points  below  the  mirror.  The  three  contact  points  against  the  back  of  the  mirror 
should  be  equally  spaced  on  a  diameter  that  is  0.645  of  the  overall  mirror 
diameter.  The  two  support  points  below  the  mirror  should  be  90  deg  apart, 
and  equally  spaced  at  45  deg  on  either  side  of  local  vertical.  This  five-point 
configuration  minimizes  self- weight  deflection  of  the  mirror  surface.  Figure 
3.19  shows  the  classic  five-point  kinematic  mirror  mount. 

An  alternative  kinematic  configuration  uses  three  equally  spaced  points  of 
attachment  to  the  mirror  circumference.  Each  point  of  attachment  provides 
constraint  in  two  directions:  radial  and  tangential.  Self-weight  deflection  of 


Fig.  3.19  Five-point  kinematic  mirror  mount. 


174 


IR/EO  HANDBOOK 


Fig.  3.20  Semikinematic  mirror  mount  patented  by  Mesco. 


this  type  of  kinematic  mount  is  greater  than  that  of  the  classic  five-point  mount. 
The  main  advantages  of  the  three-point  edge  mount  are  the  ability  to  attach 
the  mirror  to  the  mount  to  a  surrounding  ring  and  the  suitability  for  using 
the  three  mounting  points  to  athermalize  the  mirror. 

Rectangular  mirrors  are  mounted  using  a  variant  of  the  classic  five-point 
kinematic  support.  The  back  of  the  mirror  is  provided  with  three  supports, 
and  two  more  supports  are  located  along  one  edge.  One  back  support  is  located 
at  the  midpoint  of  one  long  edge.  The  other  two  back  supports  are  located  at 
the  corners  of  the  opposite  edge.  Both  edge  supports  are  located  on  the  same 
long  edge  as  the  preceding  two  supports,  and  are  located  a  distance  0.22  of  the 
overall  edge  length  from  each  corner.  This  five-point  support  minimizes  self¬ 
weight  deflection  of  a  rectangular  mirror.  Figure  3.20  shows  a  five-point  ki¬ 
nematic  mount  for  a  rectangular  mirror. 

Semikinematic  Mirror  Mounts.  True  point  contact  between  the  mirror  and 
mount  produces  relatively  large  contact  stresses  in  the  point  contacts.  These 
large  stresses  may  exceed  the  microyield  strength  of  the  materials  used,  re¬ 
sulting  in  instability  of  the  mirror  position.  Deflection  may  be  excessive  in 
point  contacts  due  to  high  stress.  Contact  stress  is  reduced  if  each  contact  point 
is  replaced  with  a  small  contact  area.  Kinematic  principles  are  used  to  locate 
the  contacts.  This  concept  of  using  kinematic  located  points  with  areas  of 
contacts  large  enough  to  reduce  stresses  to  acceptable  levels  is  called  semikine¬ 
matic  design.  Semikinematic  mounting  is  the  most  frequently  used  technique 
for  mirror  mounts. 

The  geometry  of  the  contact  areas  used  in  semikinematic  mounting  is  a 
major  design  problem.  If  the  contact  areas  are  not  flat  and  coplanar,  stress  is 
induced  in  the  mounted  optic.  Stress  is  reduced  by  improving  the  flatness  and 
by  reducing  tilt  between  the  contact  areas.  Semikinematic  mounts  are  often 
used  in  diamond-turning  applications  where  the  usual  tolerance  on  flatness 
and  coplanarity  of  the  contact  area  is  the  same  as  the  mirror  surface.  For  most 
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applications,  this  tolerance  is  too  extreme  and  can  be  relaxed.  A  more  realistic 
tolerance  for  flatness  and  tilts  of  the  contact  surface  is  a  tolerance  equivalent 
to  the  surface  deformation  in  the  contact  area. 

An  alternative  to  very  small  tolerances  in  the  contact  areas  is  to  allow  one 
contact  in  each  pair  of  contacts  to  rotate  with  respect  to  the  other.  The  simplest 
arrangement  for  providing  this  rotation  is  a  spherical  surface  in  contact  with 
a  cone.  This  sphere  and  cone  geometry  is  easily  modified  to  that  of  a  sphere 
sliding  in  a  cylinder.  Three  such  sphere  cylinder  contacts  around  the  edge  of 
a  mirror  provide  a  semikinematic  mount  that  is  also  athermalized.  A  change 
in  physical  size  of  the  mount  with  temperature  due  to  a  difference  in  thermal 
coefficient  of  expansion  between  mount  and  optic  is  removed  by  radial  trans¬ 
lation  of  the  spheres  in  their  respective  cylindrical  mounts.  This  type  of  mirror 
mount  has  been  patented  by  Mesco62  and  is  shown  in  Fig.  3.20. 


Flexural  Mirror  Mounts.  Flexural  mirror  mounts  are  similar  in  principle  to 
semikinematic  mounts.63  Kinematic  principles  are  used  to  determine  the  stiff¬ 
ness  of  each  flexure  used  to  mount  the  mirror.  The  classic  flexural  mirror 
mount  uses  three  flexures  attached  to  the  edge  of  the  mirror.  Each  flexure  is 
stiff  in  the  axial  and  tangential  directions  and  is  compliant  in  the  radial 
direction.  This  combination  of  stiffness  and  compliance  accurately  locates  the 
mirror,  yet  allows  the  mount  to  expand  or  contract  radially  with  respect  to 
the  mirror.  The  mirror  is  isolated  from  stresses  due  to  temperature  changes 
and  thermal  coefficient  of  expansion  difference  between  mirror  and  mount.64 
The  stiffness  of  a  flexure-mounted  mirror  is  given  by: 

Kr  =  |  (Kfr  +  Kft)  ,  (3.100) 

Ka  =  3 Kfa  ,  (3.101) 

where 

Kr  =  radial  stiffness  of  the  mirror  mount 

KFR  =  radial  stiffness  of  one  mirror  mount  flexure 

Kft  =  tangential  stiffness  of  one  mirror  mount  flexure 

Ka  =  axial  stiffness  of  the  mirror  mount 

Kfa  =  axial  stiffness  of  one  mirror  mount  flexure. 

Error  in  locating  the  flexures  can  induce  bending  forces  into  the  mirror.  This 
lack  of  assembly  accuracy  complicates  the  design  of  the  mirror  mount  flexures. 
The  effect  of  assembly  inaccuracy  is  reduced  by  introducing  additional  direc¬ 
tions  of  stiffness  and  compliance  into  each  mirror  mount  flexure.  In  the  classic 
three-flexure  design,  assembly  inaccuracy  effects  are  reduced  by  placing  a  set 
of  flexures  between  the  mounting  flexures  and  the  mirror.  This  additional  set 
of  flexures  provides  compliance  in  rotation  about  two  orthogonal  axes.  Both 
rotation  axes  are  parallel  to  the  plane  of  the  mirror  surface.  Further  reduction 
in  mirror  surface  deflection  is  possible  by  attaching  the  flexures  to  the  mirror 
in  the  plane  of  the  center  of  gravity.65  An  example  of  a  flexure-mounted  mirror 
is  shown  in  Fig.  3.21. 
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Fig.  3.21  Flexure  mirror  mount  with  tangent  bars. 


Bonded  Mirror  Mounts.  Bonding  of  mirrors  into  mounts  employs  semikine- 
matic  principles.  Bonded  areas  should  be  located  using  kinematic  principles. 
The  thickness  of  the  bond  between  mirror  and  mount  allows  relaxation  of  the 
tolerances  of  the  contact  areas.  Bonding  has  the  disadvantages  of  limited  stiff¬ 
ness  and  possible  outgassing  of  the  adhesive. 

The  simplest  type  of  bonded  mirror  mount  consists  of  a  large  circular  bonded 
area  on  the  back  of  the  mirror.  The  bond  area  is  determined  using  Eq.  (3.35). 
Stability  of  the  mirror  position  is  improved  by  providing  three  contact  points 
against  the  back  of  the  mirror  in  addition  to  the  bonded  area.  The  bonded  area 
then  acts  as  a  spring  to  keep  the  mirror  in  contact  with  the  defining  points. 

Large  areas  of  adhesive  in  contact  with  the  mirror  can  produce  severe  stresses 
when  the  temperature  is  changed  due  to  a  difference  in  thermal  coefficient  of 
expansion  between  mirror  and  adhesive.  Thermal  stress  is  reduced  by  breaking 
up  the  large  bond  area  into  smaller  areas.  One  possible  semikinematic  con¬ 
figuration  uses  three  equally  spaced  bond  areas  on  the  back  of  the  mirror.  The 
three  bond  areas  are  located  at  the  optimum  0.645  diameter. 

Most  adhesives  shrink  as  they  cure.  Shrinkage  of  the  adhesive  used  to  mount 
a  mirror  can  cause  stress  and  surface  deformation.  Stress  caused  by  shrinkage 
of  the  adhesive  is  reduced  by  isolating  the  area  of  bonding  from  the  mirror 
surface. 

Isolation  of  the  bond  area  from  the  mirror  optical  surface  is  possible  by  using 
a  modified  mirror  configuration.  One  such  configuration  uses  a  cylindrical 
"stalk”  on  the  back  of  the  mirror.  This  stalk  is  normally  about  one-third  the 
mirror  diameter  and  has  a  length  equivalent  to  the  mirror  thickness.  Adhesive 
is  placed  around  the  circumference  of  the  stalk.  This  type  of  mirror  mount  is 
known  as  a  mushroom  mount,  from  the  resemblance  of  the  mirror  to  a  mush¬ 
room.66  Figure  3.22  shows  a  bonded  mushroom  mirror. 
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Fig.  3.22  Mushroom  mirror  mount. 


The  mushroom  mount  principle  is  turned  inside  out  in  the  center  hub  mount. 
The  center  hub  mount  uses  a  hole  bored  in  the  center  of  the  mirror.  For  a 
Cassegrain  primary  mirror,  this  hole  would  extend  through  the  mirror.  For 
other  types  of  mirrors,  the  hole  would  extend  close  to  the  surface,  but  would 
not  break  through.  The  depth  of  the  hole  in  the  mirror  back  must  be  sufficient 
to  reach  the  plane  of  the  center  of  gravity  of  the  mirror.  Normally,  the  bond 
area  is  limited  to  a  line  around  the  circumference  of  the  inside  of  the  hole, 
and  at  the  location  of  the  center  of  gravity. 

Another  bonded  mount  uses  three  bosses  around  the  circumference  of  the 
mirror.  The  mirror  is  bonded  to  its  mount  via  adhesive  placed  on  the  three 
bosses.  To  isolate  the  mirror  from  expansion  or  contraction  of  the  mirror  mount, 
each  boss  is  connected  to  the  mirror  mount  by  a  flexure.  The  flexure  is  stiff  in 
the  axial  and  tangential  directions,  and  is  compliant  in  the  radial  direction. 

3.7  ATHERMALIZATION 
3.7.1  Structural  Athermalization 

Changes  in  temperature  can  cause  the  spacing  between  optical  elements  of  a 
system  to  change.  This  change  can  create  a  change  in  focus,  or  disturb  the 
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alignment  of  the  system.  The  optical  support  structure  is  said  to  be  ather- 
malized  if  it  compensates  for  these  temperature  effects. 

Often  overlooked  in  evaluating  temperature  effects  is  the  effect  of  the  at¬ 
mosphere  inside  or  near  the  system.  The  index  of  refraction  of  air  varies  with 
temperature.  If  there  is  a  temperature  change  along  the  path,  optical  aber¬ 
ration  is  introduced  into  the  beam.  The  index  of  refraction  of  air  at  a  constant 
pressure  of  760  mm  Hg  is  given  by67: 


nr  -  1  =  (ft is  “  1) 


1.0549 

1  +  0.00366  Ta  ’ 


(3.102) 


(/Us  -  1)  x  108  =  8,342.1  + 


2,406,030 
130  -  1/A2 


15,996 

38.9  -  1/A2  * 


(3.103) 


where 

nT  =  refractive  index  of  air  at  a  temperature  T 
ft15  =  refractive  index  of  air  at  15°C 
Ta  =  air  temperature  (degree  centigrade) 

A  =  wavelength  (micrometers). 

If  possible,  the  air  inside  and  near  an  optical  instrument  should  be  maintained 
in  a  uniform  temperature  condition.  Attempts  to  make  the  air  more  homo¬ 
geneous  by  stirring  with  fans  are  usually  not  successful.  Placing  a  close-fitting 
thermal-insulated  cover  around  the  optical  beam  path  normally  reduces  air 
temperature  variation.  Heat  sources  should  be  located  so  that  heat  does  not 
rise  into  the  beam.  Very  sensitive  optical  instruments  can  be  isolated  from 
air-temperature  variation  effects  by  operating  in  a  helium  atmosphere.68  In 
extreme  cases,  the  optical  system  may  need  to  be  operated  in  a  vacuum.69 

3.7.2  Same  Material  Athermalization 

When  both  structure  and  optics  are  made  of  the  same  material,  an  athermal 
structure  is  produced.  A  uniform  change  in  temperature  of  a  reflective  optic 
changes  the  focal  length  and  the  physical  size  of  the  mirror.  If  the  mirror  is 
mounted  using  a  material  that  is  the  same  as  the  mirror,  the  same  change  in 
temperature  produces  a  corresponding  change  in  physical  size  in  the  mirror 
mount.  This  corresponding  size  change  in  the  mirror  mount  eliminates  mount¬ 
ing  stress  due  to  the  temperature  change. 

Change  in  focus  with  temperature  is  proportional  to  the  thermal  coefficient 
of  expansion  of  the  mirror.  If  the  focus  is  located  using  a  structure  made  of 
the  same  type  of  material  as  the  mirror,  the  length  of  the  structure  changes 
with  temperature  in  an  amount  corresponding  to  the  change  in  focus.  Focus 
is  maintained  if  both  mirror  and  structure  are  made  of  the  same  type  of  material. 

This  same-material  athermalization  principle  is  employed  in  all  metal  op¬ 
tical  systems.  Common  metal  materials  used  for  same-material  athermaliza¬ 
tion  include  aluminum  and  beryllium.  An  all-glass  Cassegrain  telescope  can 
employ  the  same  principle.  In  this  case,  the  secondary  mirror  is  mounted  on 
a  window  made  of  the  same  type  of  glass  as  the  primary  mirror. 

Same-material  athermalized  systems  are  commonly  employed  in  IR  appli¬ 
cations.  Performance  of  this  type  of  athermalized  system  is  limited  by  vul- 
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nerability  to  temperature  gradients.  A  gradient  along  or  perpendicular  to  the 
optical  axis  will  disturb  the  performance  of  a  same-material  athermalized 
system. 


3.7.3  Athermal  Compensators 

The  index  of  refraction  of  transmissive  optical  materials  changes  with  tem¬ 
perature.  The  change  in  refractive  index  of  a  material  with  temperature  is 
called  the  thermo -optic  coefficient  of  the  material.  This  change  in  refractive 
index  of  material  with  temperature  causes  the  focal  length  of  a  lens  to  change 
with  temperature.  Lens  power  is  defined  as  the  reciprocal  of  the  lens  focal 
length.  The  change  in  lens  power  with  temperature  is  then  given  by70: 
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where 
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change  in  lens  power  with  temperature 
lens  power 

optothermal  expansion  coefficient 

thermal  coefficient  of  the  lens  material 

thermo-optic  coefficient  of  the  lens  material 

refractive  index  of  the  lens  material 

change  in  the  refractive  index  of  air  with  temperature. 


Neglecting  air  temperature  effects,  an  approximate  version  of  Eq.  (3.104)  is 
given  by: 


_  1  dnG 

P  “G  (nG  -  1)  dT  ’ 


(3.105) 


Table  3.9  gives  the  optothermal  expansion  coefficient  of  some  typical  lens 
materials. 


Table  3.9  Thermo-Optic  Coefficients  for  Optical  Materials 


Material 

n 

X 

(nm) 

dn/dt 

(icr6/K) 

PK51 

1.53019 

546.1 

-8.5 

FK3 

1.46619 

546.1 

-0.1 

BK7 

1.51872 

546.1 

3.0 

LaKlO 

1.72340 

546.1 

5.0 

SF5 

1.67764 

546.1 

5.8 

SF6 

1.81265 

546.1 

11.6 

Fused  silica 

1.45850 

587.6 

8.1 

CVD  ZnSe 

2.473 

1150 

59.7 

CVD  ZnS 

2.279 

1150 

49.8 

Silicon 

2.38 

10  }Jim 

162.0 

KRS-5 

2.37 

10  (xm 

-235.0 

Germanium 

4.003 

10  fxm 

396.0 
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For  a  system  of  thin  lenses,  the  change  in  system  power  with  temperature 
is  given  by: 


dKs 

dT 


=  ks(-Vs)  = 


(3.106) 


where 

dKs/dT  =  change  in  system  power  with  temperature 

ps  =  optothermal  coefficient  of  expansion  of  the  system 

Ks  =  system  power 

Ki  =  individual  element  power 

p i  =  optothermal  coefficient  of  expansion  of  the  individual 

element 

n  =  number  of  elements. 

For  passive  maintenance  of  focus  with  temperature,  the  thermal  coefficient 
of  expansion  of  the  structure  must  equal  the  optothermal  coefficient  of  expan¬ 
sion.  This  requirement  is  difficult  to  meet  with  a  single  type  of  material.  Most 
optical  systems  do  not  have  optothermal  coefficients  of  expansion  that  match 
the  thermal  coefficients  of  expansion  of  common  structural  materials.  In  some 
cases,  the  optothermal  expansion  coefficient  of  the  system  is  negative. 

Virtually  any  thermal  coefficient  of  expansion,  including  negative  values, 
can  be  achieved  in  a  structure  by  using  a  pair  of  materials.  A  combination  of 
a  high  and  low  thermal  coefficient  of  expansion  material  is  used  in  series  to 
produce  the  desired  thermal  coefficient  of  expansion.  By  adjusting  the  lengths 
of  the  two  materials,  the  thermal  coefficient  of  expansion  of  the  structure  is 
adjusted.  For  passive  maintenance  of  focus  with  temperature,  the  following 
equations  are  used  to  calculate  the  material  lengths: 


ps/  =  aiLi  +  (X2Z/2  > 

(3.107) 

/XPs/a,  -  1) 

2  (a2/aj  -  1)  ’ 

(3.108) 

Li=f-U, 

(3.109) 

where 

f  =  system  focal  length 

L2  =  length  of  the  high  thermal  coefficient  of  expansion  material 
a2  =  thermal  coefficient  of  expansion  of  the  high  thermal  coefficient  of 
expansion  material 

Li  =  length  of  the  low  thermal  coefficient  of  expansion  material 
ax  =  thermal  coefficient  of  expansion  of  the  low  thermal  coefficient  of 
expansion  material. 

Table  3.10  gives  representative  combinations  of  materials  to  match  the  opto¬ 
thermal  coefficients  of  expansion  of  some  optical  materials.  Figure  3.23  shows 
two  sample  bimetallic  compensator  configurations. 


Table  3.10  Some  Bimetallic  Compensators  for  Single  Elements 


OPTOMECHANICAL  SYSTEM  DESIGN  181 


182  IR/EO  HANDBOOK 


Lens 
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High  Expansion 
Material 


Fig.  3.23  Athermal  bimetallic  compensators. 


Mirror  systems,  and  systems  with  small  optothermal  coefficients  of  expan¬ 
sion,  require  structures  made  of  low  thermal  coefficient  of  expansion  materials 
for  effective  athermalization.  Typical  low  thermal  coefficient  of  expansion  ma¬ 
terials  used  for  this  purpose  include  Invar,  Super  Invar,  Corning  Code  7971 
ULE®,  Schott  Zerodur®,  and  the  graphite  epoxy  composites.  All  of  these  ma¬ 
terials  present  special  problems  to  the  designer. 

Invar  and  Super  Invar  are  heavy,  expensive,  difficult  to  machine,  and  have 
controversial  long-term  stability.  These  disadvantages  limit  all-invar  struc¬ 
tures  to  relatively  small  sizes.  The  disadvantages  of  Invar  materials  are  avoided 
by  using  this  type  of  material  in  a  metering  structure.  In  a  metering  structure, 
the  optical  elements  are  supported  by  a  structure  made  of  conventional  ma¬ 
terial.  The  optical  mounts  are  attached  to  the  structure  via  a  compliant  con- 
nection.  Motion  of  each  mount  along  the  optical  axis  of  the  system  is  possible. 
All  mounts  are  tied  together  by  Invar  rods.  The  Invar  rods  maintain  correct 
spacing  and,  therefore,  preserve  system  focus  as  the  support  structure  expands 
or  contracts.  The  same  approach  is  used  with  fused  silica  or  zero  thermal 
coefficient  of  expansion  glass  ceramic  rods.  A  metering  rod  structure  is  shown 
in  Fig.  3.24. 

Graphite  epoxy  composites  have  considerable  promise  for  athermalizing 
structures.72  The  thermal  coefficient  of  expansion  of  a  graphite  epoxy  composite 
material  can  be  tailored  to  virtually  any  value,  at  least  in  one  direction.  Graph¬ 
ite  composite  structures  have  exceptional  stiffness-to- weight  ratios.  A  serious 
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Fig.  3.24  Metering  rods  maintain  focus  in  an  athermalized  Cassegrain  telescope  at  the 
Space  Dynamics  Laboratory,  Utah  State  University. 


disadvantage  of  the  graphite  epoxy  composite  materials  is  dimensional  insta¬ 
bility  caused  by  the  absorption  of  water.  A  change  in  humidity  can  cause  a 
graphite  epoxy  structure  to  change  in  size  enough  to  affect  the  performance 
of  the  optical  system.73  Humidity  absorption  in  graphite  epoxy  structures  is 
reduced  by  cladding  the  structure  with  a  flexible  hermetically  sealed  mem¬ 
brane.  Damage  to  the  membrane  in  service  and  residual  water  inside  the 
membrane  are  two  problems  of  this  approach. 


3.8  EXAMPLE  PROBLEMS 
3.8.1  Window  Design 

A  500-mm-diam  circular  ZnSe  window  is  used  on  an  aircraft  flying  at  an 
altitude  of  12  km.  Instrument  bay  pressure  and  temperature  are  27  KPa  and 
300  K,  respectively.  Ambient  conditions  are  a  pressure  of  19  KPa  and  a  tem¬ 
perature  of  217  K.  A  window  failure  probability  of  10“ 4  with  a  safety  factor 
of  4  is  acceptable.  Calculate  the  safe  window  thickness  and  the  deflections  due 
to  pressure  and  temperature  differentials. 

Solution.  Failure  strength  is  given  using  Weibull  statistics.  Solving  Eq.  (3.19) 
for  stress,  and  using  the  lowest  values  for  ZnSe  in  Table  3.7: 
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(7a  =  ffo[-ln(l  -  PF)fm 

=  23  x  106[  —  lxi(l  -  10_4)]Ve 

=  7.27  X  106  Pa  . 

Using  conservative  practice,  assuming  the  window  to  be  simply  supported, 
Eq.  (3.6)  gives  the  minimum  window  thickness: 

d  _  [  8gf  Vl 

h  ~  ^|_3AP(3  +  v)SF 

J  8(7.27  x  106) _ l*2 

“  2  3(27  x  103  -  19  x  103)(3  +  0.28)4 

=  27.2  , 

h  =  §T2  =  0M8m  ' 

From  the  properties  given  in  Tables  3.5  and  3.9,  and  using  Eq.  (3.2),  the  thermal 
deformation  of  the  window  due  to  the  axial  temperature  gradient  is: 

m,  OOP  ^  217X18)  ,  83  „  103  w/m* 

"  h  0.018 

/  \2 

-  =  -  —  (- )  (0.018X83  x  103)2  =  12.4  x  10  -  6m_1  . 
f  n  \KJ 

The  pressure-induced  distortion  is  found  using  Eq.  (3.4): 

„  . (re  -  1)A P2d6 

OPD  =  8.89  x  10  3 - - 

_  (8.89  x  10~3)(2.473  -  1)(8  x  103)2(  -  5)6 
_  (71.9  x  109)2(0.018)5 

=  1.37  x  10'9  m  . 

This  example  shows  that  window  deformation  due  to  pressure  and  temperature 
differentials  is  usually  not  a  problem  in  most  common  service  environments. 


3.8.2  Dome  Design 

A  50-mm-radius  ZnS  dome  is  used  as  a  streamlined  window  on  a  mortar  shell. 
The  dome  is  2.4  mm  thick.  Firing  acceleration  is  11  x  103g.  What  are  the 
stress  in  the  dome  and  the  failure  probability  at  that  stress? 
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Solution.  Because  the  ratio  of  dome  radius  to  thickness  exceeds  10(50/2.4  = 
20.8),  Eqs.  (3.12)  and  (3.13)  are  used  to  find  the  stress.  The  equivalent  external 
pressure  is  found  using  Eq.  (3.14): 


AP  =  -ph  =  (11  x  103)(4.1  x  103)(9. 81X0.0024)  =  1.06  x  106  Pa  . 
8 

The  maximum  stresses  are: 


R 


J 50  x  10 


(Tm  =  =  (1.06  X  10  )y2  4  x  10 

Using  Eq  (3.19),  the  failure  probability  is: 


-5  =  22.1  x  10°  Pa  . 


Pf  =  1  —  exp 


U0 


=  1  -  exp 


22.1  x  106 
29  x  106 


9-i 


=  0.08  . 


3.8.3  Prism  Mounting 

A  fused  silica  right  triangular  prism,  25  mm  thick  and  25  mm  on  each  face, 
is  adhesive  bonded  to  a  mount.  Prism  acceleration  is  10  g.  Using  an  adhesive 
with  a  bond  strength  of  14  MPa,  and  a  safety  factor  of  4,  what  bond  area  is 
required? 

Solution.  Prism  weight  is  given  by: 

W  =  phA  =  ip hbL 

=  |(2.20  x  103)(0. 025)(0.035)(0. 018)  =  17.3  x  103  kg  . 


Using  Eq.  (3.35), 


aWSF 

<T 


(10X17.3  x  10~3)4(9.81) 
(9.81X14  x  106) 


=  49.42  x  10-6  m2  . 


If  a  circular  bond  area  is  used,  its  diameter  will  be: 


D  = 


4(49.42  x  1Q-6)]^ 

7T 


=  7.932  x  10-3  m  . 


This  diameter  is  approximately  one-third  the  face  length. 


3.8.4  Bonded  Lens  Cell 

A  double  convex  BK7  lens  is  bonded  into  an  aluminum  lens  cell.  The  lens  is 
50  mm  in  diameter,  with  a  20-mm  central  thickness.  Radii  of  curvature  are 
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0.15  and  0.10  m.  Using  an  elastomer  adhesive  with  properties  given  below, 
determine  the  optimum  adhesive  thickness  required  to  athermalize  the  lens 
and  the  self-weight-induced  radial  deflection  of  the  lens. 

Solution.  First  find  the  lens  edge  thickness  using  Eq.  (3.41): 


he  =  hr  —  hsihs2 


=  0.020  -  {(0.15)2  -  [(0.15)2  -  (0.025)2]^}  -  {(0.10)2  -  [(0.025)2]1'5} 
=  0.020  -  0.0021  -  0.0032  =  0.0147  m  . 

Then  find  the  lens  weight  using  Eqs.  (3.37)  and  (3.42): 

W  =  heD2  +  'nph^^Ri - — ^  +  ^ph2s2(R  “2 


=  ?(2.53  x  103)(0.014)(0.050)2 
4 

+  tt(2.53  X  103)(0.0021)2^0.15 

+  tt(2.53  x  103)(0.0032)2(o.10 
=  86.31  x  10“3  kg  . 


0.002l\ 
3  ) 

0.0032\ 

3  ) 


The  adhesive  properties  are: 

a  =  200  x  106  m/m  K 
E  =  160  MPa 
G  =  56  MPa 
v  =  0.43. 

The  optimum  bond  thickness  is  given  by  Eq.  (3.48): 

Dg(oim  —  OLg) 

r  2(ar  -  dm) 

=  0-05(23  x  10  6  -  7.1  x  10  6)  =  2  24g  x  10-3  m 
2(200  x  10~6  -  23  x  10  6) 

The  self-weight  deflection  is  given  by  Eq.  (3.49): 

_ Wl 

5i  ”  (n/2)dG(hGlhr)[Er/a  -  v2)  +  GA 
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_ _ (86.31  x  10~3)(9.81) _ 

(7r/2)(0.05)(0.0147/0.00246){(160  x  106)/[1  -  ( —  43)2]  +  56  x  106} 

=  7.151  x  10~9  m  . 

This  example  shows  that  the  adhesive  thickness  required  to  athermalize  the 
lens  is  relatively  large.  However,  this  adhesive  bond  is  relatively  stiff. 

3.8.5  Mechanical  Lens  Mount 

The  BK7  lens  from  the  example  in  Sec.  3.8.4  is  mounted  in  a  mechanical  seat 
and  retainer  cell.  The  lens  is  to  be  used  at  a  low  temperature  of 220  K;  assembly 
is  at  300  K.  The  lens  cell  is  aluminum,  with  a  5-mm  radial  wall  thickness.  A 
sharp-edged  seat  and  retainer  are  used.  Initial  assembly  preload  is  equal  to 
10  times  the  lens  weight.  Initial  radial  clearance  between  lens  and  cell  is 

2.5  fxm.  Find  the  preload  and  temperature  stresses  on  the  lens.  Retainer  and 
seat  have  a  0.04-m  common  diameter  and  a  corner  radius  of  50  fxm. 

Solution.  According  to  Eq.  (3.53),  the  maximum  stress  is  independent  of  lens 
radius  if  the  lens  radius  is  much  greater  than  the  contact  radius,  so  a  single¬ 
stress  calculation  will  suffice: 


{FI2vr)[{dG  +  dm)/dGdm\  p 
(1  -  vq)/Eg  +  (1  -  v2m)IEm\ 


=  070C/[(847  x  10~3)/2-tr(0.02)]{(0.10  +  0.01)/[(0. 10X0.01)]}  Y/2 
'  9  U1  -  (0.2)2]/(80.7  x  109)  +  [1  -  (0.3)2]/(69  x  109)  / 

=  4.34  x  106  Pa  . 

The  radial  stress  caused  by  the  temperature  drop  is  given  by  Eqs.  (3.56)  and  (3.57): 


Kr 


1  - 


hr 

r —  Ctg) 


_ 2.5  x  IQ6 _ 

(0.02X80X23  x  10“6  -  7.1  x  10“6) 


0.902  , 


=  KrAT(am  -  ag)  _  (0.902)(980)(23  x  10~6  -  7.1  x  KT6) 
”  1  IEg  +  rG/Emhm  l/(80.7  x  109)  +  0.02/[(69  x  109)(0.005)] 

=  16.3  x  106  Pa  . 


This  example  illustrates  the  very  high  stresses  created  by  assembly  preload 
forces  and  thermal  effects. 

3.8.6  Small  Circular  Mirror  Mount 

A  0.3-m-diam  ft 5  aluminum  mirror  is  mounted  at  a  45-deg  angle  with  respect 
to  vertical.  The  mirror  is  a  50-mm  thick  right  circular  cylinder.  An  optimum 
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five-point  (three  back,  two  edge)  kinematic  mount  is  used.  What  is  the  self¬ 
weight  deflection  of  the  mirror? 

Solution.  From  Eq.  (3.61),  the  self-weight  deflection  is  the  sum  of  the  radial 
and  axial  deflection  components.  The  optimum  location  for  the  three-axial 
supports  is  at  0.645(0.3)  =  0.194  m.  Equation  (3.63)  gives  the  axial  deflection: 


5a  =  0.318|^(1  -  v)  =  0.318 


(2.71  x  103)(9.81)  (0.15)4 
69  x  109  (0.05)2 


x  [1  -  (0.3)2]  =  22.6  x  10“9  m  . 


The  optimum  location  for  the  radial  supports  is  at  two  points  90  deg  apart. 
Equations  (3.69)  and  (3.70),  with  data  from  Table  3.6,  are  used  to  find  the 
deflection.  The  mirror  axial  thickness  is  given  by: 


h  =  he  -  [R  -  (R2  -  r2)^]  =  0.05  -  3  +  [(3)2  -  (0.15)2]^  =  0.046  m  , 


7 


2hR 


(0.15)2 

2(0.046X3) 


0.081  , 


Sr  =  (a0  +  axy  +  a2y2) 


2pr2 

E 


+  [0.05466  +  (0.2786X0.081)  +  (0.1100X0.081)2] 

2(2.71  x  103)(9.81)(0.15)2  ,  or  w  ln-9„ 

x  - a -  =  1.35  x  10  m  . 

69  x  109 


Then  using  Eq.  (3.61), 

5m  =  [(6A  COS0)2  +  (5r  Sine)2]1^  +  {[(922.6  x  10-9)  cos45  deg]2 

+  [(1.35  x  10-9)  sin45  deg]2}1^  +  16.0  x  10“9  m  . 

This  example  shows  that  the  radial  deflection  component  of  a  small  mirror  is 
very  small,  and  can  be  neglected  in  many  applications. 


3.8.7  Lightweight  Mirror  Design 

The  aluminum  mirror  in  Sec.  3.8.6  is  replaced  with  a  beryllium  sandwich 
mirror.  The  beryllium  sandwich  mirror  faceplate  thickness  is  3  mm.  Square 
cells  are  used  in  the  core,  with  a  cell  length  of  50  mm  and  a  cell-wall  thickness 
of  1.5  mm.  The  beryllium  mirror  is  50  mm  thick.  Compare  the  weight  and 
stiffness  of  the  beryllium  and  aluminum  mirrors. 
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Solution .  The  weight  of  a  lightweight  sandwich  mirror  is  given  by  Eq.  (3.80). 
First  calculate  the  rib  solidity  ratio  using  Eq.  (3.74): 

(20  +  tc)tc  [2(0.05)  +  0.001510.0015  A  _ 

T|  =  — - s-  =  - « -  =  0.0574  . 

(p  +  to)2  (0.05  +  0.0015)2 

The  core  height  is 

hc  =  h  -  2hf  =  0.05  -  2(0.003)  =  0.044  m  . 

Then  the  weight  is: 


W  =  ^  pd2(2hf  +  y\hc) 

=  J(1.85  x  103)(0.3)2[2(0.003)  +  (0.0574X0.044)]  =  1.11  kg  . 
The  weight  of  the  aluminum  mirror  is: 

W  =  hd2  =  |  (2.71  x  103)(0.005)(0.3)2  =  9.58  kg  . 


The  ratio  of  the  weight  is: 


Wbe  _  1.11 
WaL  ~  9^58 


0.12  . 


From  Eq.  (3.62),  self-weight  bending  (stiffness  to  weight)  is  controlled  by  the 
ratio  of  the  mirror  area  density  to  flexural  rigidity.  Area  density  is  given  by 
dividing  mirror  weight  by  mirror  area: 


Aw  = 


w 

(tt/4  )d2 


1.11 

(tt/4)(0.3)2 


=  15.8  kg/m2  . 


Flexural  rigidity  of  a  sandwich  mirror  is  given  by  Eqs.  (3.78)  and  (3.79): 


h%  =  (2 hf  +  he)6  -  l  1  -  =  [2(0.003)  +  0.044] 

-  I  !  -  K0.044)3  =  42.26  x  lO”6  m3  . 


D 


Eh% 

12(1  -  v2) 


(304  x  109)(42.26  x  10 ~6) 
12[1  -  (0.017)2] 


=  1.071  x  106  Pa  m3  . 


Comparing  the  aluminum  and  beryllium  mirrors: 


190  IR/EO  HANDBOOK 


[(PIE)(llh2)]Ah  [(2.71  x  103)(9.81)]/[(69  x  109)(0.05)2] 
(. AwID)be  ~  15.8/(1.071  x  106) 


154  x  10-6 
14.8  x  10-6 


10.4  . 


So  the  aluminum  mirror  deflects  10.4  times  more  than  the  beryllium  mirror. 

3.8.8  Thermal  Effects  on  Mirrors 

A  right  circular  cylinder  (10-to-l  diameter-to-thickness  ratio)  0.5-m-diam  f!2 
concave  mirror  is  used  in  a  cryogenic  IR  telescope.  The  mirror  is  cooled  from 
300  to  100  K.  There  is  a  temperature  gradient  of  2  K/m  along  the  optical  axis, 
and  gradient  of  1  K/m  in  the  plane  of  the  mirror.  What  are  the  thermal  de¬ 
formations  of  the  mirror? 

Solution.  From  the  problem  statement  and  Tables  3.5  and  3.8: 


R  =  2fD  =  2(2)(0.5)  -2m, 


r 


D  =  05 
2  2 


0.25  m  , 


,  d  0.5 

h  10  10 


0.50  m  , 


where 

a  =  560  x  10_9m/mK 
Aa  =  2  x  10-9  (m  K)-1 
Co  -  300  K  -  100  K  -  200  K 
C2  =  1  K/m 
C3  =  2  K/m  . 


Using  Eq.  (3.84),  the  following  aberration  terms  are  computed: 


_  .  .  .  _  «C3  *  (560  x  10~9)(2)(0.25)4  _  i0„  ^  ln-i2  „ 

Spherical:  8  =  ^2r  =  - -  =  137  x  10  m  , 

Coma:  8  =  cos6  +  sin6 


Focus: 


5  = 


(560  x  10~9)(1)(0.25) 

(2)(2) 

[aC:\h  aC:i  _  «CP 

2 R  2  “  2R 

=  (560  x  10_9)(0.25)2 

=  1.72  x  10-6  m  . 


=  2.19  x  10"9  m  , 


2(0.05)  2  200 

2(2)  2  +  2C2 


OPTOMECHANICAL  SYSTEM  DESIGN  191 


Using  Eq.  (3.88),  the  aberration  due  to  an  axial  variation  in  thermal  coefficient 
of  expansion  is  computed: 


5 


2AA“AT 


(Q.25)2(2  x  10~9)(0. 05X200) 
2(0.05) 


=  12.5  x  10"9m  . 


Using  Eq.  (3.89),  the  aberration  due  to  transverse  variation  in  thermal  coef¬ 
ficient  of  expansion  is  computed: 


8  “  4h^ax  ~ 


(0.25)' 


(0.05X2  x  10“9)(0.5)(200)  =  62.5  x  10"9m 


This  example  shows  that  the  greatest  effect  of  a  temperature  change  on  a 
mirror  is  a  shift  in  focus.  In  this  example,  spatial  variation  in  thermal  coef¬ 
ficient  of  expansion  has  a  stronger  effect  than  the  thermal  gradients.  This  is 
of  interest  since  fused  silica  has  a  low  thermal  coefficient  of  expansion  and 
good  uniformity  of  thermal  coefficient  of  expansion. 


3.8.9  Thermal  Bimetallic  Bending  of  a  Metal  Mirror 

The  mirror  in  Sec.  3.8.8  is  plated  with  electroless  nickel.  The  plating  thickness 
on  the  mirror’s  optical  surface  is  75  jim,  and  plating  thickness  on  the  back  of 
the  mirror  is  125  p,m.  What  is  the  change  in  radius  and  mirror  stress  due  to 
bimetallic  bending  when  the  mirror  temperature  is  reduced  from  300  to  100  K? 

Solution.  The  change  in  mirror  radius  caused  by  bimetallic  bending  is  given 
by  Eqs.  (3.93),  (3.94),  and  (3.90): 


4*m  - 


Er 


69  x  10“9 


1  -  vm  1-0.3 
=  196  x  109  (data  from  Ref.  1)  , 


=  98.6  x  109  Pa  , 


1  1  6  typ  rr(hpl  hp2 

IB — ~B  ~  T  — (aP“am)AT' 

Ro  R  h  l| fjn 


i_fv 


6  196  x  109 


5 (13  x  0-6  -  23  x  1(TS)(100) 


R  2  0.05  98.6  x  10 

'75  x  10"6  -  125  x  10“6 


1  - 


0.05 


75  x  10“6  -  125  x  10“6\/,  196  x  109 

4— - —  -  1 


0.05 


98.6  x  109 


=  0.5  -  240  x  10-6  =  499.7598  x  10-3  , 

AR  =  R0  -  R  =  2  -  (499.7598  x  lO-3)”1  =  961  x  10“6 


m  . 
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The  mirror  stress  is  given  by  Eq.  (3.91): 


{hp2  hp\ )  (hp2 


~h  J 


&rm  ^p(otp  Q-n? )  A  T 


=  196  x  109(13  x  10~6  -  23  x  10  6)(100) 

(125  x  10-6  -  75  x  10"6)  (125  x  10~6  +  75  x  10~6) 

3  005  +  0.05 

=  -196  x  103  Pa  . 


This  example  shows  that  the  change  in  radius  due  to  bimetallic  bending  is 
significant,  at  about  1  mm.  The  bimetallic  bending  stress  is  well  below  the  65- 
MPa  microyield  of  aluminum. 
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4.1  INTRODUCTION 

Complete  characterization  of  infrared  imaging  systems  includes  measuring 
the  signal  transfer  function  (SiTF),  resolution,  slit  response  function  (SRF), 
noise  equivalent  differential  temperature  (NEDT),  modulation  transfer  func¬ 
tion  (MTF),  and  the  minimum  resolvable  temperature  (MRT)  difference.  The 
MTF  can  be  calculated  from  the  contrast  transfer  function  (CTF).  All  these 
metrics  can  be  considered  as  output/input  transformations.  The  output  is  typ¬ 
ically  a  voltage  level  change  on  the  analog  video  or  the  change  in  monitor 
luminance.  Depending  on  the  test,  the  input  may  be  temperature  difference, 
target  angular  subtence,  or  target  spatial  frequency.  Table  4.1  gives  the  no¬ 
menclature  used  in  this  chapter. 


Table  4.1  Symbols  and  Nomenclature 


Ad 

Detector  area 

CTF 

Contrast  transfer  function 

d 

Target  size  (one  bar) 

ds 

Size  of  extended  source 

Dco\ 

Collimator  clear  aperture 

DSys 

Imaging  system  clear  aperture 

/col 

Collimator  effective  focal  length 

fsys 

Infrared  system  effective  focal  length 

fo 

Spatial  frequency  corresponding  to  one-half  the  inverse  of  the  detector  IFOV 

fs 

Sampling  frequency 

fl# 

/■number  equal  to  fayJDsys 

FPN 

Fixed  pattern  noise 

FWHM 

Full  width  at  half  maximum 

G 

Electronic  amplifier  gain 

Hn) 

Imaginary  part  of  the  complex  transfer  function 

IFOV 

Instantaneous  field  of  view 

LSF 

Line  spread  function 

Me(\,T) 

Planck’s  blackbody  radiation  law 

MRT 

Minimum  resolvable  temperature 

MTF 

Modulation  transfer  function 

NEDT 

Noise  equivalent  differential  temperature 

NU 

Nonuniformity 

*00 

Detector  spectral  responsivity 

»(n) 

Real  part  of  the  complex  transfer  function 

SiTF 

Signal  transfer  function 

SRF 

Slit  response  function 

TatmOO 

Atmospheric  spectral  transmittance 

Tcoi(X) 

Collimator  spectral  transmittance 

TsyJM 

System  spectral  transmittance 

Tb 

Background  temperature 

Tt 

Target  temperature 

TV 

Active  time  for  one  video  line 
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The  responsivity  function  is  the  output/input  transformation  in  which  the 
target  size  is  fixed  and  the  target  intensity  is  varied.  It  is  typically  S-shaped. 
For  dc  coupled  systems,  the  dark  current  (or  noise  floor)  limits  the  minimum 
detectable  signal  and  saturation  limits  the  maximum  detectable  signal.  For 
many  systems,  the  electronics  have  a  limited  dynamic  range  compared  to  the 
detector  and  then  the  output  is  centered  about  some  average  value.  Saturation 
in  the  positive  and  negative  directions  about  this  average  value  is  typically 
limited  electronically  (Fig.  4.1)  by  the  dynamic  range  of  an  amplifier  or  analog- 
to-digital  (A/D)  converter.  The  linear  portion  (slope)  of  the  responsivity  func¬ 
tion  is  the  SiTF.  The  SiTF  must  be  measured  to  calculate  the  NEDT.  The  SiTF 
is  not  typically  reported,  but  the  dynamic  range  often  is.  Dynamic  range  is 
defined  as  the  maximum  measurable  signal  divided  by  the  minimum  mea¬ 
surable  signal.  For  infrared  imaging  systems,  the  minimum  value  is  usually 
taken  as  the  noise  level  or  NEDT.  For  example,  an  infrared  system  whose 
output  is  linear  over  an  input  range  of  AT  =  25°C  and  has  an  NEDT  of  0.1°C 
has  a  dynamic  range  of  250:1  or  48  dB.  For  digital  non-noisy  systems,  the 
minimum  value  is  the  least  significant  bit,  so  that  an  8-bit  A/D  converter  has 
a  dynamic  range  of  256:1. 

Resolution  can  be  defined  by  a  variety  of  methods;  the  two  most  popular  are 
the  instantaneous  field  of  view  (IFOV)  and  the  imaging  resolution.  The  (geo¬ 
metric)  IFOV  is  the  detector  active  size  divided  by  the  infrared  imaging  sys¬ 
tem’s  effective  focal  length.  The  imaging  resolution  is  that  slit  angular  sub- 
tence  at  which  the  SRF  is  0.5  (Fig.  4.2).  The  SRF  is  the  output/input 
transformation  in  which  the  target  intensity  is  fixed  and  the  target  angular 
subtence  is  varied.  For  an  ideal  system,  the  imaging  resolution  is  one-half  of 


Saturation 


Fig.  4.1  Typical  responsivity  function  illustrating  the  SiTF.  The  dynamic  range  is  the 
maximum  linear  input  range  divided  by  the  NEDT. 
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Fig.  4.2  Slit  response  function.  For  an  ideal  system,  the  imaging  IFOV  is  1/2  the  geometric 
IFOV. 


the  IFOV.  Commercial  vendors  tend  to  use  the  imaging  resolution  when  spec¬ 
ifying  system  resolution.  The  imaging  resolution  includes  both  the  system’s 
optical  and  electronic  response  and  may  be  more  representative  of  actual  sys¬ 
tem  response  than  the  calculated  geometric  IFOV. 

Noise  is  defined  in  the  broadest  sense  as  any  unwanted  signal  components 
that  arise  from  a  variety  of  sources.  The  rms  noise  voltage  can  be  referred  to 
the  input  as  that  input  that  produces  an  SNR  of  unity.  By  dividing  the  rms 
noise  voltage  by  the  SiTF,  the  NEDT  is  obtained.  The  NEDT  is  a  measure  of 
system  sensitivity  only.  It  is  an  excellent  diagnostic  tool  for  production  testing 
to  verify  performance.  It  is  a  poor  system-to-system  performance  parameter 
and  should  be  used  cautiously  when  comparing  systems  built  to  different  de¬ 
signs.  Depending  on  the  detector  configuration  and  the  scan  pattern,  spatial 
and  temporal  noise  can  occur  in  a  variety  of  ways.  Because  of  the  many  ways 
that  noise  can  appear,  it  is  evaluated  in  terms  of  a  three-dimensional  noise 
model.  This  noise  model  incorporates  the  NEDT,  fixed  pattern  noise  (FPN), 
and  nonuniformity. 

The  MTF  is  a  fundamental  parameter  used  for  system  design,  analysis,  and 
specifications.  The  3-D  noise  model  parameters  and  MTF  uniquely  define  sys¬ 
tem  performance.  Theoretically,  the  SRF  and  CTF  can  be  calculated  from  the 
MTF.  If  the  eye’s  detection  threshold  can  be  accurately  modeled,  the  MRT  can 
also  be  calculated.  However,  it  is  often  easier  to  measure  these  parameters 
rather  than  calculate  them. 

Methods  to  measure  the  MTF  depend  on  both  optical  and  electronic  signal 
considerations.  It  is  the  system’s  response  to  spatial  sinusoidal  signals.  MTF 
is  a  measure  of  how  well  the  system  faithfully  reproduces  the  scene.  As  the 
MTF  decreases,  scene  detail  associated  with  those  specific  spatial  frequencies 
are  reproduced  with  lower  contrast.  The  limit,  where  the  MTF  approaches  zero, 
is  the  system  cutoff.  The  system  can  detect  signals  whose  spatial  frequencies 
are  above  cutoff  but  cannot  faithfully  reproduce  them.  For  example,  a  four-bar 


200  IR/EO  HANDBOOK 


pattern  appears  as  a  blob.  In  undersampled  systems  such  as  staring  arrays, 
the  MTF  is  defined  only  up  to  the  Nyquist  frequency.  Spatial  frequencies  above 
Nyquist  are  aliased  to  lower  spatial  frequencies.  In  this  case,  a  four-bar  pattern 
may  appear  as  a  distorted  three-bar  pattern.  From  a  design  point  of  view,  the 
MTF  should  be  "high”  over  the  spatial  frequencies  of  interest.  The  spatial 
frequencies  of  interest  are  application  specific. 

There  are  two  general  approaches  for  determining  the  MTF:  the  direct  method, 
which  consists  of  measuring  the  response  to  sinusoidal  targets,  and  the  indirect 
method  in  which  a  one-dimensional  MTF  is  obtained  from  the  Fourier  trans¬ 
form  of  the  line  spread  function  (LSF).  There  are  benefits  and  shortcomings 
to  both  methods.  Sinusoidal  patterns  are  available  in  the  visible  but  not  easy 
to  fabricate  for  the  infrared.  One  could  use  square  (bar)  targets  to  obtain  the 
CTF  and  mathematically  convert  to  the  sinusoidal  response  (MTF)  using  a 
series  approximation. 

Modulation  is  defined  by 


modulation  = 


■Bmax  -Bmin 
^max  “I"  B  min 


(4.1) 


where  Bm ax  and  £min  are  the  maximum  and  minimum  intensity  levels  defined 
in  Fig.  4.3.  The  modulation  transfer  function  is  given  by 

MTF  =  image  modulation  (4  2) 

object  modulation 

It  is  plotted  as  a  function  of  spatial  frequency,  as  shown  in  Fig.  4.4.  The  CTF 
is  the  system’s  response  to  square  waves.  Using  Fig.  4.4  as  a  reference,  if  the 
sinusoids  are  replaced  with  square  waves,  the  CTF  is  obtained. 

MRT  is  a  subjective  measure  of  image  quality.  It  is  a  laboratory  summary 
measure  that  combines  visual  sensitivity  and  resolution  (Fig.  4.5).  MRT  is  a 
measure  of  an  observer’s  ability  to  resolve  a  four-bar  pattern  embedded  in 
noise.  Visual  sensitivity  is  the  measure  of  the  lowest  SNR  that  is  acceptable 
to  the  eye.  The  resolution  limit  is  related  to  the  smallest  detail  that  can  be 


Fig.  4.3  Definition  of  modulation. 
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Fig.  4.4  Definition  of  modulation  transfer  for  three  spatial  frequencies:  (a)  input  (object) 
modulation,  (b)  output  (image)  modulation,  and  (c)  the  MTF. 


faithfully  reproduced.  Because  MRT  is  inversely  related  to  the  MTF,  as  the 
MTF  -»  0,  the  MRT  <».  Because  of  the  eye’s  incredible  ability  to  spatially 
and  temporally  integrate  signals,  the  low-frequency  MRT  asymptote  depends 
on  the  amount  of  low-frequency  noise  (nonuniformity)  present.  With  minimal 
low-frequency  noise,  the  MRT  asymptotes  to  zero.1  With  modest  noise,  the 
MRT  asymptotes2,3  somewhere  between  0.3  and  0.7  times  the  NEDT.  The  MRT 
results  depend  on  decisions  made  by  an  observer.  The  results  vary  with  train¬ 
ing,  motivation,  and  visual  capacity.  Because  of  the  larger  inter-  and  intraob¬ 
server  variability,  several  observers  are  required. 

Object  space  spatial  frequency  is  used  to  characterize  the  MTF,  CTF,  and 
MRT.  The  angle  subtended  by  one  cycle  (one  bar  and  one  space)  is  given  by 
2 d/R,  where  2d  is  the  spatial  extent  of  one  cycle  and  R  is  the  distance  from 
the  infrared  imaging  system  entrance  aperture  to  the  target  (Fig.  4.6).  If  a 
collimator  is  used,  R  is  replaced  by  the  focal  length  of  the  collimator  /col  so 
that  targets  placed  in  the  collimator’s  focal  plane  can  be  described  in  object 
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Fig.  4.5  MRT  as  a  function  of  spatial  frequency. 


j—  2d— ;  f*d*< 


Fig.  4.6  Definition  of  spatial  frequency. 
MRT  targets  have  a  7:1  aspect  ratio. 


space.  The  object  space  spatial  frequency  fx  is  the  inverse  of  the  target  angular 
subtense  and  is  usually  measured  in  cycles  per  milliradian: 


1  =  1  /  /coiA 

1000  \2d)  °r  h  1000  V  2d  )  ' 


(4.3) 


Although  this  chapter  focuses  on  the  characterization  of  infrared  imaging 
systems,  the  test  equipment,  test  methodology,  and  data  analysis  is  generic  to 
all  electro-optical  imaging  systems.  Aside  from  using  different  sources  (e.g.,  a 
CIE  C  source  for  the  visible  and  a  blackbody  for  the  infrared),  the  only  major 
difference  is  the  nomenclature.  For  example,  the  linear  portion  of  the  respon- 
sivity  function  is  the  responsivity  for  systems  operating  in  the  visible  and  the 
SiTF  for  infrared  imaging  systems.  The  rms  noise  voltage  when  referred  to 
the  input  produces  the  noise  equivalent  background  input  for  visible  systems 
and  the  NEDT  for  infrared  imaging  systems. 


4.2  TEST  PHILOSOPHY 

Before  undertaking  a  test  program,  it  is  necessary  to  establish  a  test  philosophy 
and  write  a  thorough  test  plan.  The  test  plan  states  the  objectives,  require¬ 
ments,  data  analysis  methodology,  and  the  success  criteria  of  the  test.  The  test 
configuration  and  measuring  conditions  must  be  clearly  stated. 

Design  engineers  and  test  engineers  must  anticipate  all  foreseeable  com¬ 
binations  of  circumstances.  Test  procedures  can  only  be  developed  when  the 
operation  of  the  system  is  fully  understood  and  the  test  objectives  are  fully 
understood.  An  intimate  understanding  of  how  the  system  operates  and  the 
expected  results  is  a  fundamental  necessity.  The  specific  tests  selected  depend 
on  the  infrared  system  application. 
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Because  of  the  complexities  of  modern  infrared  systems,  it  is  essential  to 
employ  state-of-the-art  measuring  equipment  and  the  latest  test  concepts  and 
to  ensure  proper  data  analysis  is  used.  However,  finding  adequate  test  equip¬ 
ment  becomes  a  challenge  as  infrared  system  technology  advances.  With  the 
emerging  requirements  for  more  sensitive  and  more  accurate  infrared  systems, 
the  measurement  techniques  become  more  stringent.  In  some  areas,  test  equip¬ 
ment  technology  has  not  kept  pace  with  the  advances  in  infrared  system 
technology. 

Because  the  data  set  tends  to  be  small,  appropriate  statistical  measures 
must  be  considered.  A  variety  of  statistics  are  appropriate  for  imaging  sys¬ 
tems.4  General  data  analyses  can  be  found  in  texts  such  as  Dixon  and  Massey5 
and  Bendat  and  Piersol.6  Formal  error  analysis  techniques  can  be  found  in  a 
variety  of  texts  (see  for  example,  Ref.  7). 

At  the  conclusion  of  the  test,  fully  document  any  test  abnormality  and  all 
results.  The  recorded  data  should  include  as  a  minimum  the  raw  data,  all 
calculated  results,  ambient  temperature,  and  any  other  pertinent  measuring 
data.  The  data  should  be  shown  both  graphically  and  in  tabular  form  and,  if 
appropriate,  the  calculated  least-squares  regression  line  should  overlay  the 
data  points.  Data  should  be  in  a  format  useful  to  multiple  users  and  multiple 
analysts.  With  the  widespread  use  of  personal  computers,  it  is  prudent  to  store 
all  data  in  a  format  consistent  with  that  used  by  the  more  common  spreadsheets 
and  database  programs. 


4.3  RADIOMETRY  AND  THE  AT  CONCEPT 

A  linear  system  produces  an  output  voltage  difference  that  is  proportional  to 
the  radiant  exitance  difference  between  a  target  and  its  background.  Assuming 
a  Lambertian  source  and  a  circular  unobscured  aperture,  the  voltage  differ¬ 
ence  is 


AV 


f 


G  R(X) 


A  Me 

4  (f/#)2 


/Ratm(X)TCol(X)T3yS {X)Ad  dX  , 


(4.4) 


where  A Me  is  the  spectral  radiant  exitance  difference  between  the  target  and 
its  background  equal  to  Me(\,Tr)  -  Me(k,TB ).  For  small  signals  and  averaged 
transmittances,  Eq.  (4.4)  can  be  approximated  by 


AV  =  G 


Tcol  Tatm  TSyS  ATsourceArf 


4  (/*/#)' 


K 2  dMe(X,TB) 
R(X) — dX 


dT 


(4.5) 


where  the  thermal  derivative  (derivative  of  Planck's  blackbody  law  with  re¬ 
spect  to  temperature)  is  evaluated  at  the  background  temperature  TB. 

The  responsivity  function  is  the  output/input  transformation,  or  AWAMe. 
For  systems  operating  in  the  visible,  the  source  intensity  is  often  varied  by 
inserting  neutral  density  filters.  For  infrared  imaging  systems,  it  is  convenient 
to  express  a  small  radiant  exitance  difference  by  an  effective  temperature 
difference,  or  AT^m-ee-  Equation  (4.5)  can  then  be  represented  by 
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AV  =  SiTFAT  ,  (4.6) 

where 

AT  —  Tcol  Tatm  ATgource  >  (4.7) 

where  ATS0Urce  is  proportional  to  the  thermal  derivative,  which  in  turn  is  a 
function  of  wavelength  and  the  background  temperature  (Fig.  4.7).  Most  in¬ 
frared  imaging  systems  do  not  measure  temperature  but  rather  respond  to 
radiance  differences,  and  radiance  differences  are  nonlinear  with  scene  tem¬ 
perature.  As  a  result,  all  measurements  that  use  AT  as  an  input  are  affected 
by  the  background  temperature.  The  AT  concept  is  a  matter  of  convenience. 
The  radiant  exitance  difference  between  280  and  281  K  is  different  than  that 
between  300  and  301  K  even  though  the  thermometric  difference  is  1  deg.  In 
the  8-  to  12-|jim  spectral  region,  a  temperature  differential  of  1.2°  at  280°C 
produces  the  same  radiant  exitance  differential  as  1°  at  300°C  (Fig.  4.8).  Equiv- 


Fig.  4.7  Thermal  derivative  of  Planck’s  blackbody  law  for  three  background  temperatures. 
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5  x  1 0'4 


Background  Temperature 


Fig.  4.8  Representative  radiant  exitance  differences  for  a  fixed  thermometric  difference 
in  the  8-  to  12-|i,m  region.  The  precise  difference  depends  on  the  system’s  spectral  response. 


(a)  (b) 

Fig.  4.9  MRT  variation  as  a  function  of  (a)  spatial  frequency  and  (b)  background  temperature. 


alently,  as  the  background  temperature  decreases,  a  larger  thermometric  dif¬ 
ference  is  required  to  produce  a  constant  SNR.  A  drift  in  ambient  of  1  K 
manifests  itself  as  a  AT  change  of  0.02  K.  Background  temperature  changes 
affect8’9’10  the  MRT  (Fig.  4.9)  and  the  NEDT  (Fig.  4.10).  The  3-  to  5-fim  region 
is  more  sensitive  to  background  changes  than  the  8-  to  12-jxm  region.  By 
allowing  the  ambient  temperature  to  drift  from  300  to  305  K,  the  NEDT  has 
approximately  14%  variation  in  the  3-  to  5-|nm  spectral  region  and  approxi- 
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Fig.  4.10  Representative  percentage  error  (relative  to  300  K)  in  the  NEDT  for  different 
background  temperatures  for  (a)  3-  to  5-jxm  and  (b)  8-  to  12-^m  spectral  region.  The  precise 
error  depends  on  the  system’s  spectral  response. 


mately  5%  in  the  8-  to  12-jxm  spectral  region.  This  clearly  illustrates  that 
although  the  AT  concept  may  be  useful  for  thermometers,  it  does  not  uniquely 
specify  infrared  imaging  system  performance  unless  both  the  spectral  response 
of  the  system  and  the  ambient  (background)  temperature  are  specified.  Figures 
4.8  through  4.10  should  be  taken  as  representative.  The  specific  variations 
with  ambient  temperature  depend  on  the  spectral  response  of  the  system.  The 
linear  approximation  given  by  Eq.  (4.6)  is  valid  only  for  small  excursions  about 
the  assumed  background  temperature. 

4.4  TEST  CONFIGURATIONS 

The  purpose  of  the  source,  target,  and  collimator  is  to  present  standardized 
targets  of  known  intensity  to  the  infrared  imaging  system.  The  collimator 
aberrations  should  be  significantly  less  than  the  aberrations  of  the  system 
under  test.  Because  aberrations11  are  inversely  proportional  to  //#  or  to  powers 
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of  /*/#,  the  /*/#  of  the  collimator  should  be  greater  than  the  /*/#  of  the  system 
under  test.  Equivalently,  the  focal  length  of  the  collimator  should  be  much 
longer  than  the  focal  length  of  the  system  under  test.  As  a  general  guideline, 
the  collimator  focal  length  should  be  at  least  five  times  that  of  the  system 
under  test.  Collimators  are  lens  or  mirror  assemblies  that  optically  place  tar¬ 
gets  at  infinity.  Collimators  may  contain  either  refractive  or  reflective  ele¬ 
ments.  Either  can  be  used  in  the  visible  spectral  region,  whereas  reflective 
collimators  are  generally  used  in  the  infrared  spectral  region  because  infrared 
refractive  optics  tend  to  be  dispersive  and  reflective  mirrors  do  not  have  chro¬ 
matic  aberrations.  Parabolic  mirrors  do  not  have  spherical  aberrations,  and 
therefore  parabolic  mirrors  tend  to  be  a  better  choice.  Off-axis  parabolic  col¬ 
limators  allow  maximum  throughput  in  the  sense  that  the  source  does  not 
physically  interfere  with  the  collimated  beam. 

Although  a  point  source  produces  parallel  light  when  placed  in  the  focal 
plane  of  a  collimator,  an  extended  source  of  size  ds  can  be  fully  seen  only  in 
a  well-defined  region  (Fig.  4.11)  that  extends  out  to  a  distance  L  from  the 
collimator  lens  or  mirror: 


The  infrared  imaging  system  must  be  placed  inside  the  cone  defined  by  the 
collimator  clear  aperture  and  L.  The  maximum  distance  R  that  the  system 
can  be  placed  is  determined  by  the  system’s  aperture: 


Extended  Source 


Fig.  4.11  Available  working  distance  using  a  collimator  and  extended  source. 
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R  =  ^(Z)coi  -  Dsys)  .  (4.9) 

ds 

The  value  of  ds  used  for  these  calculations  should  be  the  largest  anticipated 
size  of  the  target  and  its  background.  The  collimator  aperture  should  be  suf¬ 
ficiently  large  so  that  no  extraordinary  care  is  required  to  center  the  imaging 
system  onto  the  collimator. 

Example  1.  What  is  the  maximum  distance  that  an  infrared  imaging  system 
can  be  placed  from  a  collimator  whose  focal  length  is  40  in.  and  clear  aperture 
is  6  in.?  The  imaging  system’s  entrance  aperture  is  5  in.  The  largest  linear 
angular  dimension  (target  plus  background)  to  be  viewed  subtends  20  mrad. 

target  size  =  ds  =  /colO  =  (40)(20  x  10“3)  =  0.8  in.  ,  (4.10) 

R  =£  fj^(Dcoi  -  Dsys)  =  i|(6  -  5)  =  50  in.  .  (4.11) 

CLs  U.o 

At  this  distance,  the  infrared  imaging  system  must  be  precisely  on-axis  with 
the  collimator.  The  imaging  system  should  be  placed  at  a  shorter  distance  to 
alleviate  alignment  difficulties.  □ 

The  source  intensity  reaching  the  infrared  imaging  system  is  modified  by 
the  collimator  transmittance  and  the  atmospheric  transmittance  [Eq.  (4.7)]. 
For  short  pathlengths,  the  atmospheric  transmittance  approaches  unity  in  the 
usual  imaging  bands.  For  longer  pathlengths,  the  atmospheric  transmittance 
must  be  considered  in  the  measurements.  For  systems  whose  spectral  response 
lies  in  those  regions  where  the  atmospheric  transmittance  affects  the  results, 
it  is  necessary  to  perform  a  detailed  analysis  to  appropriately  account  for  the 
atmospheric  transmittance. 

Figure  4.12  illustrates  the  various  methods  by  which  the  output  can  be 
measured.  The  analog  video  can  be  captured  with  a  frame  grabber  (image 
capture  board),  transient  recorder,  or  an  oscilloscope.  Because  of  phasing  ef¬ 
fects,  just  satisfying  the  Nyquist  criterion  (two  samples  per  highest  frequency) 
is  insufficient  when  amplitude  and/or  pulse  fidelity  are  characteristics  of  in¬ 
terest.  The  measurement  equipment  bandwidth  must  be  greater  than  the  in¬ 
frared  imaging  system  bandwidth  to  avoid  phasing  problems.  It  is  prudent  to 
verify  system  bandwidth  prior  to  selecting  measuring  equipment.  The  output 
video  may  be  in  a  standard  format  in  terms  of  timing  (e.g.,  RS  170)  but  may 
have  a  much  wider  bandwidth  than  the  standard  video  format.  The  sampling 
rate  of  the  frame  grabber  is  usually  fixed  and  may  be  too  slow  to  match  the 
pixel  rate  of  the  infrared  imaging  system.  In  those  cases,  a  frame  grabber  is 
appropriate  for  only  those  measurements  that  deal  with  low-frequency  re¬ 
sponse,  such  as  the  SiTF. 

The  monitor  luminance  can  be  measured  with  a  scanning  microphotometer, 
stationary  solid-state  camera  (CCD  camera),  or  scanning  fiber  optic  bundle. 
This  method  is  appropriate  for  those  systems  that  have  an  integral  monitor 
(direct  view  devices)  or  are  manufactured  with  specialized  (unique)  monitors. 
Monitor  performance  is  not  consistent,12  and  each  monitor  should  be  calibrated 
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Standard 


Fig.  4.12  Various  methods  of  capturing  the  system  output. 


before  starting  any  test.  The  advantage  of  measuring  the  monitor  luminance 
is  its  greater  adaptability.  Neither  the  test  equipment  nor  the  measurement 
techniques  need  to  be  changed  as  different  infrared  imaging  systems  with 
different  video  standards  are  tested. 

4.5  SIGNAL  TRANSFER  FUNCTION 

The  test  configuration  for  measuring  the  responsivity  function  is  shown  in  Fig. 
4.13.  Ideally,  the  background  should  fill  the  entire  field  of  view  so  that  there 
are  no  competing  effects  from  the  surroundings.  In  a  well-designed  system, 
the  measured  SiTF  should  approach  the  calculated  value  [Eqs.  (4.5)  and  (4.6)]. 
The  SiTF  can  vary  from  system  to  system  if  the  spectral  response  of  each 
system  is  different.  SiTF  by  itself  is  not  a  very  good  metric  for  comparing 
different  systems  because  it  can  be  changed  simply  by  changing  the  linear 
gain.  If  the  SiTF  is  specified,  it  usually  implies  that  the  system  is  operating 
at  maximum  gain. 

With  ac  coupled  scanning  systems,  the  signal  is  coupled  in  the  horizontal 
direction  but  not  in  the  vertical  direction.  As  a  result,  there  is  an  overall 
voltage  shift  (signal  and  background)  in  the  scan  direction,  which  is  not  present 
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Typical 

Target 


Fig.  4.13  Responsivity  function  test  configuration. 
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Fig.  4.14  The  ac  coupling  changes  the  absolute  value  of  the  output  when  viewing  a  target: 
(a)  two  lines  across  the  field  of  view  and  (b)  output  voltages  for  the  two  lines. 


in  the  vertical  direction  (Fig.  4.14).  The  voltage  difference  between  the  signal 
and  the  background  must  be  measured,  not  just  the  peak  values  of  the  signal. 
The  ac  coupling  extends  the  dynamic  range  in  that  the  available  differential 
voltage  (between  the  target  and  its  background)  can  be  equal  to  the  full  avail¬ 
able  output  voltage  if  the  target  fills  50%  of  the  field  of  view.  Small-area  targets 
reach  saturation  before  large-area  targets  do  and  small-area  targets  have  a 
smaller  dynamic  range.  The  target  size  must  be  specified  if  saturation  or 
dynamic  range  is  specified. 

The  SiTF  is  the  linear  slope  of  the  responsivity  curve  (Fig.  4.1).  The  best 
estimate  of  the  slope  can  be  determined  by  performing  a  least-squares  fit  to 
N  data  point  pairs  (AV;,AT;): 
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SiTF 


N  N  N 

N^AViATi  -  'ZAVi^ATi 

i-  1 _ i  =  1 _ i  -  1 

N  /  N 

NZ^Ti)2  -  (  2>Ti 

i  =  1  \j=l 


(4.12) 


There  may  be  an  offset  in  the  responsivity  function,  which  may  result  from 
the  inability  to  measure  the  background  temperature  accurately  and/or  from 
different  emittances  between  the  target  and  its  background.  It  is  this  offset 
that  should  be  noted  at  different  laboratories  when  comparing  test  techniques. 
Unless  it  is  known  that  no  offset  exists,  the  SiTF  cannot  be  accurately  deter¬ 
mined  by  making  a  measurement  at  one  input  value  only.  The  offset  is 

V offset  =  AV  -  SiTF  AT  ,  (4.13) 

where 

N 

_  2  AT, 

AT  =  ,  (4.14) 

and 

N 

__  X  AVi 

AV  =  .  (4.15) 


The  SiTF  test  procedure  is  as  follows: 

1.  Measure  the  output  voltage  difference  between  the  target  and  its  back¬ 
ground  for  a  variety  of  source  intensities  (AT;). 

2.  Multiply  all  AT;’s  by  the  average  collimator  transmittance  and  av¬ 
erage  atmospheric  transmittance  to  obtain  the  AT  at  the  infrared 
imaging  system  entrance  window. 

3.  Plot  all  data  points  as  well  as  the  least-squares  fit  to  the  linear  portion 
of  the  responsivity  function. 

4.  Record  the  SiTF  and  the  ambient  temperature. 

It  is  extremely  important  to  have  unambiguous  testable  specifications.  Since 
AT  is  a  function  of  the  background  temperature,  the  SiTF  specification  must 
clearly  state  the  measurement  conditions  (Table  4.2). 


Table  4.2  Typical  SiTF  Specification 


The  SiTF  shall  be  greater  than  0.2  V/°C  when  the  background  temperature  is  20°C.  If  the 
measurement  is  performed  at  another  background  temperature,  a  correction  factor  must 
be  applied  (system  specific). 
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Table  4.3  SiTF  Data  Set 


ATsource 

(measured) 

AV  (mV) 
(measured) 

A71 

(at 

entrance 

aperture) 

AV 

ATAV 

(AD2 

-5 

-330 

-4 

-320 

-3 

-300 

-2.7 

-300 

810 

7.29 

-2 

-185 

-1.8 

-185 

333 

3.24 

-1 

-80 

-0.9 

-80 

72 

0.81 

1 

140 

0.9 

140 

126 

0.81 

2 

220 

1.8 

220 

396 

3.24 

3 

310 

2.7 

310 

837 

7.29 

4 

350 

5 

355 

o 

ii 

2  =  105 

2  -  2574 

2  =  22.68 

Example  2:  SiTF  Calculation.  An  output  of  an  infrared  imaging  system  was 
measured  for  10  intensity  inputs  (Table  4.3).  The  collimator  transmittance  is 
0.90  and  the  atmospheric  transmittance  is  assumed  to  be  unity.  What  is  the 
SiTF? 

The  input  AT  of  -  5,  -  4, 4,  and  5  produced  a  nonlinear  response.  As  a  result, 
these  four  values  were  eliminated  from  the  least-squares  analysis. 


=  (6X2574)  -  0 
(6X22.68)  -  0 


113.5 


(4.16) 


The  average  voltage  is  V  =  105/6  =  17.5  and  Voffset  =  17.5  —  0  =  17.5.  The 
system  output  is 


AVout  =  (113.5)AT  +  17.5  .  (4.17) 

The  data  and  least-squares  fit  are  shown  in  Fig.  4.15.  □ 

4.6  THREE-DIMENSIONAL  NOISE  MODEL 

The  noise  analysis  approach  taken  follows  that  of  D’Agostino  and  Webb.13  The 
noise  is  divided  into  a  set  of  eight  components  that  are  related  to  the  temporal 
and  spatial  dimensions  of  a  three-dimensional  coordinate  system  (Fig.  4.16). 
Analyzing  the  noise  in  this  manner  has  the  advantage  that  it  simplifies  the 
understanding  of  a  complex  phenomenon  by  breaking  it  down  into  a  manage¬ 
able  set  of  components.  Furthermore,  it  provides  the  system  designer  insight 
concerning  possible  hardware  and  software  factors  that  may  be  responsible  for 
the  noise.  For  the  system  performance  modeler,  the  method  simplifies  the 
incorporation  of  complex  noise  factors  into  model  formulations.  The  3-D  noise 
model  incorporates  the  NEDT,  FPN,  and  nonuniformity. 
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Output  Voltage  (AV) 
(mv) 


Fig.  4.15  SiTF  from  Example  4.2. 


T 


n 


Fig.  4.16  Three-dimensional  noise  coordinate  system. 


The  third  dimension  is  the  temporal  dimension  representing  the  framing 
sequence.  The  other  two  dimensions  provide  spatial  information.  However, 
depending  on  the  infrared  imaging  system  design,  the  horizontal  dimension 
may  represent  time  for  a  scanning  system  or  may  represent  space  for  a  staring 
system.  For  a  staring  array,  m  and  n  indicate  detector  locations.  For  pushbroom 
scanning  systems,  m  indicates  detector  locations  and  n  is  the  digitized  analog 
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signal.  For  serial  scanning  systems,  m  is  the  number  of  raster  lines  and  n  is 
the  digitized  analog  signal. 

Noise  may  manifest  itself  in  a  variety  of  different  ways,  such  as  line-to-line 
nonuniformity,  rain,  moving  bands,  and  flashing  channels.  These  effects  are 
difficult  to  quantify  because  of  the  transitory  nature  of  the  noise.  Some  noise 
may  be  very  easy  to  perceive  but  difficult  to  measure.  For  example,  the  eye  is 
very  sensitive  to  intensity  variations  that  change  from  frame  to  frame  (flicker). 
The  flicker  may  be  low  in  intensity  and  not  easily  measured  in  a  single  frame 
but  may  be  very  noticeable  in  active  video. 

Table  4.4  lists  seven  noise  components  and  some  possible  contributors  to 
the  components  for  serial  scanning,  parallel  scanning,  and  staring  array  im¬ 
aging  systems.  For  mathematical  completeness,  the  noise  model  has  eight 
components  with  the  eighth  being  the  global  average  value  S.  Depending  on 
the  system  design  and  operation,  any  one  of  these  noise  components  could 
dominate.  The  origin  of  these  components  are  significantly  different  and  the 


Table  4.4  Seven  Noise  Components  of  the  3-D  Noise  Model 


3-D  Noise 
Component 

Description 

Serial 

Scan 

Parallel  Scan 

Staring  Array 

Ntvh 

Random  3-D  noise 

Random  and 

Ilf  noise 

Random  and  1  If 
noise 

Random  and  1  If 
noise 

Nvh 

Spatial  noise  that 
does  not  change 
from  frame  to 
frame 

Nonuniformity 

Nonuniformity 

FPN  and 
nonuniformity 

Nth 

Variations  in 
column  averages 
that  change  from 
frame  to  frame 
(rain) 

EMI* 

Readout  electronics 

Ntv 

Variations  in  row 
averages  that 
change  from 
frame  to  frame 
(streaking) 

EMI* 

Transients 

(flashing 

detectors) 

Readout  electronics 

Nv 

Variations  in  row 
averages  that  are 
fixed  in  time 
(horizontal  lines 
or  bands) 

Line-to-line 

interpolation 

Detector  response 
variations,  line-to- 
line  interpolation 

Readout  electronics, 

line-to-line 

interpolation 

Nh 

Variations  in 
column  averages 
that  are  fixed  in 
time  (vertical 
lines) 

Readout  electronics 

Nt 

Frame-to-frame 

intensity 

variations 

(flicker) 

Frame 

processing 

Frame  processing 

Frame  processing 

*Electromagnetic  interference 
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Table  4.6  Number  of 
Elements  in  Each  Noise 

Table  4.5  Three-Dimensional  Noise  Descriptors  Component 


3-D  Noise 
Component 

Number  of 
Elements,  Ne 

Ntvh 

m  x  n  x  N 

Nvh 

m  x  n 

Nth 

n  x  N 

Ntv 

m  x  N 

Nv 

m 

Nh 

n 

Nt 

N 

S 

1 

Temporal  Noise 
Component 

Spatial  Noise 
Component 

Pixel  variations 

Ntvh 

Nvh 

Row  variations 

Ntv 

Nv 

Column  variations 

Nth 

Nh 

Frame  variations 

Nt 

S 

existence  and  manifestation  depends  on  the  specific  design  of  the  infrared 
system.  Not  all  of  the  components  may  be  present  in  every  infrared  system. 
Certain  noise  sources,  such  as  microphonics,  are  more  difficult  to  describe 
because  they  may  appear  in  a  wide  variety  of  forms.  This  is  illustrated  by 
listing  readout  electronics  as  a  catch-all  phrase  for  staring  array  artifacts.  The 
3-D  noise  model  provides  the  basic  framework  for  analyzing  the  various  noise 
sources.  Depending  on  the  system  design  and  operation,  the  same  noise  source 
may  appear  in  different  noise  components.  The  spatial  and  temporal  compo¬ 
nents  are  shown  in  Table  4.5.  The  number  of  data  elements  for  each  component 
is  given  in  Table  4.6  and  illustrated  in  Fig.  4.17.  The  complete  data  set  Ntvh 
was  illustrated  in  Fig.  4.16. 


m 


n 


Data  Set  NVH  Data  Set 

Each  Pixel  Is  Averaged  Each  Row  Is  Averaged 
Over  N  Frames  Over  n  Pixels 


Data  Set  NTH 
Each  Column  Is  Averaged 
Over  m  Pixels 


1 


m 


n 


Data  Set  Nv  Data  Set  NH 

Each  Row  Is  Averaged  Each  Column  Is  Averaged 
Over  n  Pixels  and  Over  m  Pixels  and  N  Frames 
N  Frames 


Data  Set  NT 

Each  Frame  Is  Averaged 
Over  m  x  n  Pixels 


Fig.  4.17  Three-dimensional  model  data  sets. 
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Table  4.7  NEDT,  FPN,  and  Nonuniformity 


3-D  Noise 
Component 

Frequency 

Component 

Serial  Scan 

Parallel  Scan 

Staring  Array 

High 

NEDT 

NEDT 

■ 

Ntvh 

Low 

nf 

Vf 

High 

_ 

— 

FPN 

Nvh 

Low 

Nonuniformity 

Nonuniformity 

Nonuniformity 

The  temporal  and  spatial  noise  can  be  further  divided  into  high-  and  low- 
frequency  components  (Table  4.7).  The  NEDT  is  defined  for  high-frequency 
temporal  noise,  and  low-frequency  temporal  noise  is  Ilf  noise.  High-frequency 
spatial  noise  is  the  fixed  pattern  noise  and  low-frequency  spatial  noise  is  non¬ 
uniformity.  The  observer  sees  the  effects  of  both  spatial  and  temporal  noise 
simultaneously.  Low-frequency  components  appear  as  streaks  or  variations  in 
luminance  on  the  monitor,  which  affect  the  low-spatial-frequency  MRT  results. 
Unless  the  system  is  designed  to  reproduce  large  low-contrast  targets,  the  low- 
frequency  components  tend  to  be  annoying,  but  generally  do  not  affect  the 
intended  use  of  the  system.  The  high-frequency  components  can  significantly 
affect  the  ability  to  resolve  small  detail. 

Low-frequency  noise  is  defined  as  any  noise  that  has  frequency  components 
less  than  150  kHz  and  high-frequency  noise  as  noise  that  has  components  above 
150  kHz,  when  referred  to  the  standard  RS  170  video  format.14  The  150-kHz 
bandpass  filter  can  either  be  implemented  in  hardware  or  simulated  in  soft¬ 
ware.  Because  RS  170  has  a  bandwidth  of  approximately  5  MHz,  the  low- 
frequency  component  represents  about  3%  of  the  noise  bandwidth.  For  other 
video  formats,  the  low-frequency  cutoff  should  be  3%  of  the  bandwidth.  The 
removal  of  low-frequency  components  from  the  high-frequency  signals  is  called 
trend  removal .15  The  high-pass  filter  removes  any  dc  offset  or  trend  in  the 
data. 

The  test  configuration  to  measure  all  noise  sources  is  shown  in  Fig.  4.18. 
The  detectors  should  be  uniformly  illuminated  (flood  illumination)  either  by 
placing  a  nonreflective  opaque  cloth  over  the  infrared  imaging  system  or  hav- 


Opaque 
Black  Cloth 


-Any  Appropriate 
Data  Collection 
Technique  Shown 
in  Figure  4-12 


Large 

Blackbody 

Infrared 
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Imaging 

(Fills  FOV) 

System 
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Technique  Shown 
in  Figure  4-12 


(a) 


(b) 


Fig.  4.18  Noise  measurement  test  configuration:  (a)  flood  illumination  created  by  a  single 
background  (ambient)  temperature  using  a  black  cloth  and  (b)  viewing  a  large  blackbody 
to  create  various  background  temperatures. 
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ing  the  system  view  a  large,  uniform  blackbody  source.  The  source  or  cloth 
must  cover  the  entire  area  that  the  detector  can  sense.  To  ensure  that  any 
nonuniformity  seen  is  not  a  result  of  the  source  (or  the  cloth),  the  source  should 
be  moved  around  to  verify  that  the  image  does  not  move  (e.g.,  any  nonuni¬ 
formity  seen  is  produced  by  the  system  and  not  the  source). 

Historically,16  NEDT  was  defined  at  the  output  of  the  postamplifiers.  For 
this  classical  measurement,  a  simple  single-pole  filter  is  added  whose  3-dB 
break  frequency  is  equal  to  the  reciprocal  of  twice  the  detector  dwell  time 
(Fig.  4.19).  For  system  measurements,  the  NEDT  is  defined  at  the  analog  video 
or  the  output  of  the  monitor.  When  measuring  the  system  NEDT,  the  external 
3-dB  filter  should  not  be  used. 

It  is  the  data  collection  and  analysis  techniques  that  allow  separation  of 
the  various  temporal  and  spatial  components.  The  high-frequency  temporal 
components  can  be  separated  from  the  spatial  components  via  a  frame  sub¬ 
traction  technique  (Fig.  4.20).  The  inclusion  of  a  high-pass  filter  provides  the 
bandpass  necessary  to  remove  trends.  The  temporal  components  are  reduced 
by  the  square  root  of  the  number  of  frames  averaged,  and  the  fixed  pattern 
components  are  not.  This  averaged  frame  is  then  subtracted  from  a  single 
frame  to  leave  only  the  temporal  variations.  This  subtraction  method  produces 
one  frame  (high-frequency  component)  of  the  data  set  Ntvh  from  which  the 
NEDT  can  be  calculated.  The  complete  data  set  contains  N  frames. 


P  re- Post 
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xd  =  Detector  Dwell  Time 


Fig.  4.19  The  3-dB  filter.  Used  only  when  measuring  the  NEDT  at  the  output  of  the 
postamplifiers. 
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Fig.  4.20  Using  a  frame  grabber  to  collect  the  high-frequency  component  of  data  set  Ntvh- 
The  NEDT  is  calculated  from  this  data  set. 
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The  standard  deviation  07  of  the  data  set  Ni  is  the  rms  noise  value  for  that 
data  set.  The  noise  components  can  be  considered  bidirectional  if  the  calculated 
variance  is  independent  of  the  direction  chosen  to  perform  the  calculation. 
That  is,  the  variances  are  essentially  the  same  whether  measured  on  a  line, 
column,  globally,  or  frame  to  frame.  Systems  exhibiting  this  behavior  are  said 
to  be  ergodic .17  If  the  system  does  not  exhibit  any  fixed  pattern  noise  and  the 
noise  is  considered  truly  bidirectional  (Nvh  =  Nth  =  Ntv  =  Nv  =  Nh  = 
Nt  =  0),  then  the  averaging  of  many  frames  is  not  necessary,  and  a  transient 
digitizer  can  be  used  to  examine  only  one  line  (Fig.  4.21).  If  there  are  minimal 
low-frequency  components,  the  high-pass  filter  can  be  eliminated. 

FPN  can  be  measured  after  averaging  many  frames  together  and  then  pass¬ 
ing  the  data  through  a  high-pass  filter  (Fig.  4.22).  FPN  is  the  standard  devia¬ 
tion  of  the  resultant  data  set.  The  amount  of  fixed  pattern  noise  can  be  ex¬ 
pressed  as  a  percentage  of  the  average  value  or  the  NEDT.  When  describing 
dc-coupled  systems  or  detector  outputs,  FPN  is  usually  normalized  to  the  av¬ 
erage  value.  But,  for  most  systems,  the  NEDT  reference  is  appropriate.  By 
using  the  NEDT  reference,  the  percentage  FPN  is  independent  of  system  gain 
and  level  settings. 

Because  of  variations  in  detectors,  variations  in  hardware  and  truncation 
errors  imposed  by  the  correction  circuitry,  the  fixed  pattern  noise  is  not  totally 
removed.  As  a  result,  the  FPN  is  a  function  of  the  correction  technique.  At 
the  calibration  points,  the  FPN  is  minimized.  At  other  background  inputs,  the 
FPN  can  be  significant18  (Fig.  4.23).  The  amount  of  FPN  present  is  system 
specific.  A  large  blackbody  source  is  required  to  measure  the  FPN  variation 
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Fig.  4.21  Using  a  transient  digitizer  to  collect  the  high-frequency  component  of  data  set 
Ntvh .  This  approach  is  valid  if  Nvh  -  Nth  =  Ntv  =  Nv  =  Nh  =  Nt  —  0.  The  NEDT 
is  calculated  from  this  data  set. 


Temporal  High  Pass 

Noise  Filter 


Computer: 
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Fig.  4.22  Collecting  data  set  Nvh  with  low-frequency  and  temporal  noise  removed.  The 
FPN  is  calculated  from  this  data  set. 
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Point 


(a) 


Fig.  4.23  FPN  as  a  function  of  background  temperature  for  systems  with  (a)  single-point 
correction  and  (b)  two-point  correction. 


with  background  temperature.  A  black  cloth  provides  only  one  background 
temperature  (ambient). 

Nonuniformity  and  Ilf  noise  can  be  obtained  with  the  same  configurations 
shown  in  Figs.  4.20  to  4.22  except  that  the  high-bandpass  filter  is  replaced 
with  a  low-bandpass  filter  whose  cutoff  frequency  is  150  kHz.  As  with  FPN, 
nonuniformity  is  defined  as  the  standard  deviation  of  the  resultant  frame  data. 
The  amount  of  nonuniformity  can  be  expressed  as  a  percentage  of  the  average 
value,  or  the  NEDT.  By  using  the  NEDT  reference,  the  nonuniformity  per¬ 
centage  is  independent  of  the  system  gain  and  level  setting. 

It  is  not  possible  to  perform  exhaustive  testing,  rather  an  inference  is  made 
about  the  population  mean  and  variance  based  on  a  finite  number  of  data 
points.  As  a  result  of  the  widespread  usage  of  Gaussian  statistics,  it  is  almost 
always  assumed  that  the  data  set  is  Gaussian  distributed: 

vfcrxp 


P(x)  = 


(4.18) 
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The  measured  variance  of,  an  estimate  of  the  true  variance  or2,  is 

2 


Nc 


of  = 


Ne  /  Ne  \ 


Ne{Ne  ~  1) 


(4.19) 


where  Ne  is  given  in  Table  4.6.  The  measured  mean  xt ,  an  estimate  of  the  true 
mean  xo,  is 


Xi  = 


Ne 


i  =  1 


Ne 


(4.20) 


From  a  statistical  point  of  view,  if  the  variance  is  measured  K  times,  each 
measurement  will  provide  a  slightly  different  result  because  only  a  finite  data 
set  was  analyzed  each  time.  The  best  estimate  of  the  variance  is  given  by 


“2  of  +  <T2  + 
CT  =  - 


+  ( 7K 


K 


(4.21) 


This  assumes  that  the  same  number  of  data  points  were  used  to  calculate  each 
a;.  Using  this  statistical  approach,  the  best  estimate  of  NEDT  is 


NEDT  = 


CTTVH 


SiTF 


/>150  kHz 

The  best  estimate  of  the  percentage  FPN  is 
(ovii/SiTF) 


FPN  =  100% 


NEDT 


150  kHz 


(4.22) 


(4.23) 


The  best  estimate  of  the  percentage  nonuniformity  is 


NU  -  100% 


(uvH/SiTF) 

NEDT 


/■=£  150  kHz 


(4.24) 


Gaussian  (or  normal)  distributions  appear  as  straight  lines  when  plotted  on 
normal-probability  graph  paper.19  The  chi-squared  goodness-of-fit  methodology 
can  also  be  used  to  determine  if  a  sample  data  set  follows  a  Gaussian  distri¬ 
bution.20  Although  the  normal-probability  graph  or  chi-squared  test  provides 
a  rigorous  test  for  normality,  a  "quick  look”  may  be  adequate  and  can  be 
obtained  by  creating  a  histogram  of  the  data  values  and  fitting  a  Gaussian 
curve  to  the  histogram.  In  Fig.  4.24,  the  probability  density  function  of  a  typical 
noise  trace  is  plotted  as  a  histogram.  On  the  data  is  also  plotted  the  assumed 
Gaussian  distribution  where  the  mean  and  standard  deviation  is  calculated 
from  Eqs.  (4.19)  and  (4.20).  If  the  distribution  is  not  Gaussian,  further  de- 
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Fig.  4.24  Measured  noise:  (a)  single  noise  trace  and  (b)  histogram  illustrating  a  Gaussian 
probability  distribution. 


scription  is  necessary  for  a  complete  characterization  of  the  noise.  Furthermore, 
if  the  data  is  not  Gaussian  distributed,  the  three-dimensional  noise  model 
must  be  reevaluated  for  the  specific  noise  statistics  present. 

Because  all  the  noise  components  are  specified  as  an  equivalent  temperature 
differential,  the  measured  value  is  dependent  on  the  background  temperature. 
Therefore,  all  specifications  must  include  the  measurement  conditions  (Table  4.8). 


4.7  SLIT  RESPONSE  FUNCTION 

The  SRF  is  the  transformation  of  input  target  angular  subtence  to  output 
voltage  for  a  fixed  target  intensity.  The  SRF  is  used  to  determine  the  imaging 
resolution.  The  test  configuration  is  shown  in  Fig.  4.25.  Because  this  test  is  a 
function  of  target  angular  subtence  only,  the  source  intensity  is  relatively 
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Table  4.8  Typical  Specifications 


NEDT 

The  NEDT  shall  not  be  greater  than  0.2°C  when  the  background  is 
23°C. 

FPN 

The  FPN  shall  not  be  greater  than  1%  of  the  NEDT  when  the 
background  is  23°C. 

The  FPN  shall  not  be  greater  than  5%  of  the  NEDT  over  the  entire 
environmental  operational  limits  ( -  20  to  +  40°C). 

Nonuniformity 

Nonuniformity  shall  not  be  greater  than  5%  of  the  NEDT  when  the 
background  is  23°C. 

If  the  measurement  is  performed  at  another  background  temperature,  a  correction  factor 
must  be  applied  (system  specific). 

Off-Axis  in  Figure  4-12 


Parabolic 

Collimator 

(a) 


Small  Slit  Large  Slit 


(b) 


Fig.  4.25  Slit  response  function:  (a)  test  configuration  and  (b)  measured  signals. 
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unimportant.  It  should  be  sufficiently  high  to  provide  a  good  SNR  without 
entering  a  nonlinear  region.  It  is  best  to  measure  the  responsivity  function 
prior  to  measuring  the  SRF  to  determine  the  maximum  level  allowable  inten¬ 
sity  without  entering  nonlinearity  or  saturation.  Recommended  target  sizes 
range  from  0.1  IFOV  to  5  IFOV.  The  output  is  normalized  to  the  maximum 
output  that  is  achieved  with  a  very  large  target  so  that  the  maximum  value 
of  the  SRF  is  unity  (Fig.  4.2).  This  value  should  be  the  same  value  as  that 
obtained  from  the  responsivity  function  for  that  input  intensity.  The  test  pro¬ 
cedure  is  as  follows: 

1.  Select  a  source  intensity  that  maximizes  the  SNR  without  entering  a 
nonlinear  region  or  saturation.  This  can  be  determined  by  examining 
the  responsivity  function. 

2.  Critically  align  the  target  onto  a  detector  to  achieve  maximum  output. 

3.  Record  the  voltage  difference  between  the  target  and  its  background. 

4.  Repeat  steps  2  and  3  for  each  target  size. 

5.  Divide  all  outputs  by  the  maximum  output.  Maximum  output  should 
be  obtained  with  the  largest  target  used  and  should  be  the  same  output 
as  that  obtained  with  the  SiTF  test  target  when  the  source  is  at  the 
same  temperature. 

6.  Fully  document  any  test  abnormality  and  all  results.  The  SRF  should 
be  presented  both  graphically  and  in  tabular  form. 

7.  The  imaging  resolution  is  that  target  angular  subtence  at  which 
SRF  =  0.5. 


4.8  MODULATION  TRANSFER  FUNCTION 

Methods  to  measure  the  MTF  depend  on  both  optical  and  electronic  signal 
considerations.  For  convenience,  the  MTF  is  measured  in  two  orthogonal  axes 
(usually  coincident  with  the  array  axes)  to  obtain  two  one-dimensional  MTFs. 
The  one-dimensional  MTF  is  the  Fourier  transform  of  the  LSF,  where  the  LSF 
is  the  resultant  waveform  produced  by  the  infrared  imaging  system  when  it 
is  viewing  an  ideal  line.  Because  an  ideal  line  can  be  obtained  by  differentiating 
a  step,  the  MTF  can  also  be  obtained  from  a  step  response  (also  known  as  the 
edge  response  and  knife-edge  response).  The  test  configuration  is  illustrated 
in  Fig.  4.26. 

The  ideal  line  does  not  have  any  finite  extent  and  the  slit  is  a  practical 
implementation  of  the  idealized  line.  As  the  slit  becomes  narrower,  the  flux 
passing  through  it  diminishes  and  a  point  is  reached  where  the  slit  intensity 
can  no  longer  be  sensed.  Therefore  a  finite  slit  is  required.  The  angular  subtense 
of  the  slit  should  be  smaller  than  the  IFOV  with  a  value  less  than  0.1  IFOV 
recommended.  A  thin  straight  heated  nichrome  wire  can  be  used  as  an  ap¬ 
proximation  to  a  slit. 

The  advantages  in  using  a  knife-edge  target  are  that  the  target  is  simpler 
to  construct  than  a  narrow  slit  and  there  is  no  MTF  correction  as  required 
when  employing  a  slit.  The  edge  is  differentiated  to  obtain  the  LSF  and  then 
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Fig.  4.26  Modulation  transfer  function:  (a)  test  configuration  and  (b)  methodology  to  ob¬ 
tain  the  MTF. 


Fourier  transformed.  However,  for  noisy  systems,  differentiation  accentuates 
the  noise  and  this  corrupts  the  resultant  MTF. 

MTF  measurements,  although  they  appear  straightforward,  may  be  difficult 
to  perform  as  a  result  of  digitization,  phasing,  background  removal,  jitter, 
noise,  and  improper  normalization.  The  magnitude  of  each  of  these  effects 
depends  on  the  infrared  imaging  system  design. 
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4.8.1  Digitization  and  Phasing  Effects 

The  effects  of  sampling  on  the  MTF  can  be  dramatic.21,22  Sampling  is  an 
inherent  feature  of  all  electronic  imaging  systems.  The  scene  is  sampled  in 
either  one  or  both  directions,  depending  on  the  scanning  mechanism  and  dis¬ 
crete  nature  of  the  detector  elements.  MTF  theory  is  based  on  isoplanatism 
and  electronic  linearity.  Sampled  data  systems  are  neither  isoplanatic  nor 
completely  linear,  and  the  MTF  can  have  a  range  of  values,  depending  on  the 
phase  between  the  internal  sampler  and  the  location  of  the  target.  It  is  ap¬ 
propriate  to  adjust  the  location  of  the  target  such  that  the  highest  possible 
MTF  is  obtained.  This  provides  the  best  performance  of  the  system. 

The  analog  signal  (containing  the  LSF)  is  digitized  prior  to  performing  the 
Fourier  transform.  The  number  of  samples  across  the  LSF  should  be  sufficiently 
high  so  that  phasing  effects  do  not  introduce  any  additional  artifacts.  To  min¬ 
imize  these  artifacts,  at  least  four  samples  across  the  LSF  at  full  width  at  half 
maximum  (FWHM)  (50%)  amplitude  are  required.  This  corresponds  approxi¬ 
mately  to  10  samples  across  the  entire  LSF.  This  is  consistent  with  the  six 
samples  across  the  edge  spread  function  (full  width  of  the  LSF)  recommended 
by  Granger23  and  the  eight  samples  FWHM  recommended  by  Dainty  and 
Shaw.24 

For  scanning  systems,  a  frame  grabber  is  not  appropriate  for  horizontal 
MTF  measurements  unless  it  can  capture  four  samples  per  FWHM  of  the  line 
spread  function.  For  staring  systems,  the  frame  grabber  may  be  synchronized 
with  the  array  so  that  the  frame  grabber  collects  data  from  every  available 
pixel.  In  the  vertical  direction,  a  frame  grabber  typically  collects  all  the  data. 
For  example,  RS  170  consists  of  480  lines  and  frame  grabbers  are  usually 
designed  to  capture  all  of  the  lines. 

Because  staring  arrays  are  undersampled,  special  precautions  must  be 
used.25,26  The  LSF  can  be  constructed  by  two  methods.  The  first  is  to  move  a 
slit  in  subpixel  increments  across  the  detector  and  measure  the  response  at 
each  location.  The  second  is  to  create  a  periodic  array  of  point  sources  whose 
locations  are  at  noninteger  locations  with  respect  to  the  detector  locations. 
This  noninteger  arrangement  is  equivalent  to  varying  the  phase  between  the 
point  sources  and  the  detectors.  To  perform  this  test,  each  point  source  size 
and  relative  location  must  be  known  precisely.  Each  response  must  be  nor¬ 
malized  according  to  its  point  source  intensity,  which  is  proportional  to  the 
point  source  size.  The  complete  LSF  can  be  reconstructed  by  overlaying  the 
various  responses  according  to  each  location27  (Fig.  4.27).  A  one-dimensional 
response  can  be  obtained  using  slits  (Fig.  4.28).  The  slit  width  must  be  known 
accurately  to  account  for  the  differences  in  radiance,  which  results  in  different 
amplitudes.  The  slits  should  be  sufficiently  separated  to  ensure  that  the  in¬ 
dividual  LSFs  do  not  overlap.  Care  must  be  exercised  in  defining  the  location 
of  the  data  points  in  time  so  that  the  Fourier  transform  is  done  properly. 
Because  most  Fourier  transform  algorithms  require  equispaced  data  points,  it 
may  be  necessary  to  interpolate  between  the  data  points. 


(a) 
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(b) 

Fig.  4.27  Reconstruction  of  the  LSF  from  a  periodic  array  of  point  sources:  (a)  point  sources 
imaged  onto  a  detector  array  and  (b)  overlaid  responses  using  data  obtained  on  row  6. 


Detector  Array 


Fig.  4.28  The  LSF  can  be  reconstructed  from  a  periodic  array  of  slits.  The  data  are  overlaid 
as  illustrated  in  Fig.  4.27(b). 


4.8.2  Background  Removal 

Before  calculating  the  Fourier  transform,  the  background  must  be  removed. 
This  is  done  either  by  making  a  separate  measurement  of  the  background  or 
by  assuming  the  background  is  uniform.  If  improperly  removed,  the  calculated 
MTF  may  be  too  high  (too  much  background  removed)  or  too  low  (insufficient 
background  removed)  (Fig.  4.29). 

Background  trends  resulting  from  target  inhomogeneities,  shading,  non¬ 
uniformity,  and  1  If  noise  must  be  removed  prior  to  performing  the  Fourier 
transform.  Very  low  frequency  Ilf  noise  can  manifest  itself  as  drift  (slow  var¬ 
iations  in  background  level).  Medium  Ilf  noise  and  shading  appear  as  a  trend 
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Fig.  4.29  Effects  of  the  background  removal  on  the  MTF. 
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Fig.  4.30  Trend  removal  to  obtain  the  LSF. 


on  the  data  (monotonically  increasing  or  decreasing  base  line)  (Fig.  4.30).  Trends15 
can  be  removed  by  applying  a  first-order  polynomial  to  the  background  data 
and  subtracting  this  line  from  the  LSF.  The  resultant  trace  should  have  zero 
mean  on  either  side  of  the  LSF  response.  Since  the  LSF  is  a  high-frequency 
response,  the  data  can  be  passed  through  a  high-pass  filter,  such  as  the  filter 
used  to  separate  the  high  and  low  noise  frequencies. 
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4.8.3  Jitter 

With  jitter  (Fig.  4.31),  the  position  of  the  LSF  peak  varies  from  frame  to  frame. 
The  jitter  may  be  a  result  of  movement  of  the  system  relative  to  the  target 
during  the  test  (mechanical  vibration)  or  inherent  jitter  in  the  system.  If  the 
jitter  results  from  synchronization  problems  in  the  transient  recorder,  then 
the  potential  MTF  degradation  is  a  result  of  the  measurement  technique. 
Mechanical  vibration  can  be  minimized  by  placing  the  source,  target,  colli¬ 
mator,  and  infrared  imaging  system  on  a  vibration  isolation  table. 

If  several  frames  are  averaged  together  to  improve  the  SNR,  jitter  in  suc¬ 
cessive  frames  can  cause  broadening  of  the  averaged  line  spread  function  and 
produce  an  MTF  that  is  lower  than  theoretically  possible.  It  may  be  desirable 
to  leave  the  jitter  in  the  measurements  if  it  is  a  property  of  the  system.  The 
reason  is  that  the  observer  sees  the  entire  system  response  including  any 
inherent  jitter.  The  eye,  and  to  some  degree  the  display,  averages  system  jitter. 
The  removal  of  jitter  yields  the  best  possible  system  MTF  but  may  not  be 
representative  of  what  the  observer  sees. 

One  way  to  align  the  traces  is  to  integrate  the  individual  LSF  traces  to 
obtain  the  edge  spread  function.  The  slope  of  the  edge  response  is  calculated 
via  a  least-squares  approach  [Eq.  (4.12)].  The  50%  point  of  the  step  response 
is  the  center  of  the  step  response  and  its  location  corresponds  (assuming  a 
symmetrical  LSF)  to  the  center  of  the  LSF  (Fig.  4.32).  By  matching  the  50% 
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Fig.  4.31  LSF  with  jitter  and  drift. 
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Fig.  4.32  Overlaying  LSFs  to  remove  jitter:  (a)  individual  LSF,  (b)  determining  center  of 
LSF  from  the  edge  spread  function,  and  (c)  overlaid  LSFs. 
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points  and  overlaying  traces,  the  LSF  is  effectively  filled  with  additional  points. 
This  increases  resolution  and  increases  the  accuracy  in  obtaining  the  LSF. 
Care  must  be  exercized  in  defining  the  location  of  the  data  points  in  time  so 
that  the  Fourier  transform  is  done  properly.  Because  many  Fourier  transform 
algorithms  require  equispaced  data  points,  it  may  be  necessary  to  interpolate 
between  the  data  points. 

4.8.4  Noise 

Noise  introduces  random  errors  and  adds  a  positive  bias  to  the  MTF.  The  MTF 
in  the  presence  of  noise  is  always  greater  than  that  without  noise.  It  has  been 
reported  that  an  SNR  of  500  may  be  required  for  accurate  MTF  measure¬ 
ments.28  To  reduce  noise,  choose  a  high  source  intensity  and,  if  possible,  a  low 
system  gain.  To  ensure  that  the  system  is  operating  in  a  linear  region,  obtain 
the  MTF  for  a  variety  of  source  intensities.  Select  the  highest  intensity  for 
which  the  MTF  is  still  well  behaved.  The  noise  bias  can  be  removed  by  ap¬ 
propriate  time  averaging.  Because  of  jitter  and  drift,  the  individual  line  spread 
functions  vary  in  time  and  absolute  voltage  level  and  averaging  must  be  done 
with  care. 

4.8.5  Fourier  Transform  Considerations 

Because  Fourier  transform  software  is  readily  available,  the  actual  compu¬ 
tation  is  not  discussed,  but  rather,  we  address  the  use  of  data  manipulation 
techniques  to  achieve  the  desired  results.  The  fast  Fourier  transform  (FFT) 
does  not  denote  a  specific  method  of  calculating  the  discrete  Fourier  transform 
but  rather  denotes  a  computationally  efficient  method  of  implementing  a  dis¬ 
crete  transform.  When  operating  on  2 N  data  points,  the  Fourier  transform 
provides  real  Sft  and  imaginary  3>  parts  of  the  complex  transfer  function,  each 
containing  N  data  points.  The  MTF  for  data  point  n  is 

MTF(ra)  =  [&2(n)  +  3>\n)]v '2  n  =  1,  2,  N  .  (4.25) 

Each  data  point  n  is  associated  with  a  frequency  given  by 


fn  =  .  (4.26) 

where  fs  is  the  sampling  rate  that  digitized  the  LSF.  For  example,  if  the  analog 
signal  is  digitized  every  20  ns,  then  fs  =  1/(20  ns)  =  5  MHz.  The  frequency 
resolution  is  A  f  -  fs/(2N).  If  the  LSF  and  its  background  is  digitized  into  1024 
samples,  then  A  f  =  4.88  MHz.  The  maximum  frequency  (Nyquist  criterion) 
that  can  be  recovered  is 


(4.27) 


Using  a  finite-length  data  record  violates  the  Fourier  transform  requirement 
of  continuity  for  all  time.  Discontinuities  of  partial  cycles  at  the  beginning  or 
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end  of  the  sample  intervals  cause  errors.  The  errors  (also  called  sidelobes  or 
leakage )  may  mask  small  amplitude  frequencies  that  are  present.  To  minimize 
leakage,  the  data  is  often  passed  through  a  filter  or  window.29  The  most  popular 
filter  is  the  Hanning  or  raised  cosine  window.  In  general,  the  choice  of  windows 
requires  knowledge  of  the  data  to  be  collected.  The  window  also  attenuates 
low-frequency  components  of  the  MTF.  The  MTF  should  be  calculated  with 
and  without  a  window  and  the  results  compared.  If  the  LSF  is  centered  on  the 
data  set,  the  window  is  probably  not  necessary. 

Noise  introduces  an  error  in  the  power  estimation  that  is  independent  of 
the  record  length.  Collecting  more  data  points  does  not  affect  the  magnitude 
of  the  error.30  To  reduce  this  error,  multiple  power  spectra  are  computed  and 
then  are  averaged  at  each  frequency  component  to  obtain  a  composite  spectra: 

Pi(f )  =  &?(/)  +  3>\if)  , 

P2(f)  =  »!(/•)  +  ■?!(/•)  , 

(4.28) 

pk(f )  =  wiif)  +  $lif) . 

The  composite  spectra  is 

£  Pi(n 

P(f )  =  -  ,  W.29) 

and  the  average  MTF  is  the  square  root  of  the  averaged  power  spectra: 

MTF(Z’)  =  [H7)l1/2  •  (4.30) 


4.8.6  Normalization 

For  passive  linear  systems,  the  MTF  is  normalized  to  unity  at  zero  spatial 
frequency  and  it  decreases  as  the  frequency  increases.  However,  image  en¬ 
hancement  techniques  and  boost  circuitry  may  increase  the  MTF  at  certain 
frequencies.  With  ac  coupled  systems,  the  dc  (zero  spatial  frequency)  component 
is  suppressed  and  thus  prevents  normalization  at  zero.  The  problem  can  be 
avoided  by  normalizing  at  a  spatial  frequency  one  decade  (10  times)  above  the 
ac  coupling  cut  on  frequency.  Then  the  MTF  curve  appears  to  approach  unity 
at  zero  spatial  frequency  and  the  increased  MTF  at  the  boost  frequency  is  a 
reminder  that  the  system  contains  peaking  components.  Note  that  the  ac  cou¬ 
pling  cut-on  frequency  may  be  below  the  spatial  resolution  A  f  of  the  Fourier 
transform  and  therefore  may  not  be  measured. 

If  the  LSF  is  measured  on  the  analog  video  (time  domain),  the  FFT  trans¬ 
forms  the  data  into  the  electrical  frequency  domain  (Hertz).  The  conversion  of 
electrical  frequency  into  spatial  frequency  requires  knowledge  of  the  field  of 
view  and  the  active  time  (TV)  for  one  TV  line: 
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Fig.  4.33  Apparent  MTF  variations  resulting  from  variations  in  the  FOV.  The  variations 
are  due  to  uncertainty  in  the  scale  factor. 


fx  = 


TV 

FOV'Hz  ' 


(4.31) 


If  the  infrared  imaging  system  operates  in  the  digital  domain  and  the  clock 
rate  is  # clock  and  the  number  of  pixels  is  P  per  line,  then 


TV 


P  clock 


(4.32) 


The  field  of  view  should  not  be  assumed  but  be  measured.  A  5%  variation 
in  FOV  during  manufacturing  is  not  uncommon.  This  manifests  itself  ap¬ 
proximately  as  a  5%  variation  in  the  scale  factor.  This,  in  turn,  appears  to 
shift  the  MTF  curve  such  that  there  may  be  up  to  a  10%  variation  in  the  MTF 
values  (Fig.  4.33). 

The  system  MTF  is  the  average  MTF  divided  by  the  MTF  of  the  test  con¬ 
figuration.  When  using  a  slit,  the  MTF  correction  is  sin(7Tafx)/(iTafx ),  where  a 
is  the  slit  angular  subtence  measured  in  object  space. 


4.8.7  MTF  Summary 

MTF  measurements,  although  straightforward,  can  be  difficult  to  perform. 
Possible  MTF  variations  are  shown  in  Fig.  4.34  with  possible  causes  given  in 
Table  4.9. 
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Table  4.9  MTF  Variations 


MTF  Variations 

Possible  Causes 

Suppressed  at  zero  spatial  frequency 
[Fig.  4.34(a)) 

ac  coupling 

Peak  at  low  frequency  [Fig.  4.34(b)] 

Trends  not  removed 

Peak  in  curve  [Fig.  4.34(c)] 

Boost  circuitry,  nonlinear  image 
processing 

Too  low  [Fig.  4.34(d)] 

System  out  of  focus 

System  in  nonlinear  region 

Jitter  broadened  LSF  (when  averaging) 
Wrong  frequency  scale  factor 

Insufficient  samples  on  LSF 

Too  high  [Fig.  4.34(e)] 

Too  much  background  removed 

Wrong  frequency  scale  factor 

Noise  bias 

Insufficient  samples  on  LSF 

Low-frequency  components  [Fig.  4.34(f)] 

Insufficient  background  removed 

Not  reproducible 

Variations  in  all  of  the  above 

MTF 


fx 

(b) 


MTF 


fx 

(C) 


MTF 


MTF 


MTF 


fx 

(d) 


fx 

(e) 


fx 

(f) 


Fig.  4.34  Variations  in  the  MTF  (see  Table  4.9  for  explanation). 


4.9  CONTRAST  TRANSFER  FUNCTION 

With  a  large  number  of  bar  targets  available  and  ease  of  fabrication,  the  CTF 
appears  easy  to  measure  and  represents  a  convenient  method  to  calculate  the 
MTF.  A  square  wave  can  be  expressed  as  a  series  of  sinusoids.  The  amplitude 
of  the  square  wave  at  frequency  fx  is  as  an  infinite  sum  of  sinusoid  amplitudes: 


CTF(  fx)  =  - 

IT 


MTF(  fx)  - 


MTF(3/i)  ,  MTF(5 fx) 


(4.33) 


or 


CTF  (/y 


4 

ir 


v  ,&MTF[(2&  +  1  )fx] 

2j  Oh  M  1 


(4.34) 
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Conversely,  the  sine  wave  amplitude  at  frequency  f  can  be  expressed  as  an 
infinite  sum  of  square-wave  amplitudes31,32: 


MTF(  fx)  = 


7 r 


CTF  (fx)  + 


CTF(3 fx)  CTF(5 fx)  ,  CTF(7/i) 


+ 


,  CTF(ll^c)  ,  .  ,  , 

+  - — - f  irregular  terms 


(4.35) 


or 


TT 


MTF(  fx)  =  - 


1  Bk 

4  =  0 


CTF  (kfx) 


(4.36) 


where 

Bk  =  (-l)m(-l)a“1)/2  for  r  =  m,  (4.37) 

and  Bk  =  0  for  r  <  m,k  -  1,  3,  5,  ...  (odd  only);  m  is  the  total  number  of 
prime  factors  in  k,  and  r  is  the  number  of  different  prime  factors  in  k.  The 
relationship  between  square-wave  and  sinusoidal  amplitude  responses  is  il¬ 
lustrated  in  Fig.  4.35. 

A  typical  CTF  test  configuration  is  shown  in  Fig.  4.36.  The  CTF  response 
is  the  difference  between  the  maximum  and  minimum  output  value.  Because 
of  phasing  effects,33  the  maximum  and  minimum  values  may  not  be  adjacent 
to  each  other  (Fig.  4.37).  As  a  result,  a  target  with  many  bars  is  required.  If 
the  data  is  captured  by  a  digital  recording  device  (frame  grabber  or  transient 
recorder),  its  sampling  rate  should  be  high  compared  to  the  infrared  imaging 
system  sampling  rate  to  avoid  any  signal  degradation.  The  CTF  must  be  nor¬ 
malized  to  unity  at  zero  spatial  frequency.  The  "zero”  spatial  frequency  value 
can  be  determined  by  measuring  the  response  to  a  very  large  target. 


Fig.  4.35  Relationship  between  CTF  and  MTF, 


234  IR/EO  HANDBOOK 


Parabolic 

Collimator 


Fig.  4.36  CTF  test  configuration. 


Input 


Output 


Maximum 


Minimum 


Fig.  4.37  Effects  of  phasing  on  output  signal  intensity. 


To  obtain  the  MTF,  many  square-wave  responses  must  be  obtained.  The 
maximum  number  is  limited  by  the  system  cutoff.  For  targets  whose  spatial 
frequency  are  above  1/3  system  cutoff,  the  MTF  is  equal  to  tt/4  times  the 
measured  CTF  (i.e.,  only  one  target  is  necessary  to  provide  the  MTF).  It  is 
often  difficult  to  determine  exactly  where  cutoff  is  and,  as  a  result,  difficult 
to  estimate  where  1/3  cutoff  is  located.  Unless  there  is  evidence  otherwise,  the 
optical  spatial  frequency  cutoff  should  be  used  as  the  system  cutoff  for  purposes 
of  calculating  the  MTF.  For  diffraction-limited  optics,  the  optical  spatial  fre¬ 
quency  cutoff  is  DsyJK  where  X  is  the  system’s  spectral  responsivity  average 
wavelength. 
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The  CTF  data  must  be  clearly  labeled  as  the  square-wave  response,  and, 
for  completeness,  the  calculated  MTF  should  also  be  shown  on  the  same  graph 
and  appropriately  labeled. 


Example  3  MTF  Calculations  from  Square-Wave  Responses.  An  infrared 
imaging  system  has  a  cutoff  at  11  c/mrad.  The  CTF  is  measured  at  1,  3,  5,  7, 
and  9  c/mrad  (Table  4.10).  What  is  the  corresponding  MTF? 


MTF(l) 

MTF(3) 


7T 

4 


TT 

4 


CTF(l)  + 
CTF(3)  + 


CTF(3) 

3 

CTF(9) 

3 


CTF®  CTF(7)~ 
5  +  7 


MTF(5)  =  ^CTF(5)  , 
4 


MTF(7)  =  tCTF(7)  ,  MTF(9)  =  ^CTF(9)  . 
4  4 


The  relationship  described  by  Eq.  (4.35)  was  developed  for  an  analog  optical 
system.  For  sampled  data  systems,  the  mathematical  relationship  between 
MTF  and  CTF  has  not  yet  been  developed.  Therefore,  Eq.  (4.35)  should  be  used 
cautiously  for  sampled  data  systems,  if  at  all.  CTF  measurements  are  appro¬ 
priate  system  performance  validation.  It  is  the  conversion  to  the  MTF  that  is 
challenged. 


4.10  MINIMUM  RESOLVABLE  TEMPERATURE 

MRT  is  a  subjective  measure  of  image  quality.  MRT  is  a  measure  of  an  ob¬ 
server's  ability  to  resolve  a  four-bar  pattern  embedded  in  noise.  It  is  a  labo¬ 
ratory  summary  measure  that  combines  visual  sensitivity  and  resolution.  The 
results  depend  on  decisions  made  by  an  observer  and  the  results  vary  with 
training,  motivation,  and  visual  capacity.  Because  of  the  large  inter-  and  in¬ 
traobserver  variability,  several  observers  are  required. 

Because  each  person  is  different,  individual  characteristics  can  affect  the 
way  people  behave.  Age,  experience,  personality,  vision,  mood,  and  intelligence 
are  just  a  few.  During  the  course  of  an  evaluation,  many  changes  take  place 
that  could  influence  the  outcome  of  a  test.  Equipment  may  show  signs  of  wear 
and  may  even  become  damaged  (e.g.,  fingerprints  on  targets).  People  learn 
new  methods,  have  new  experiences,  change  moods,  and  become  fatigued. 
Because  so  many  changes  can  occur  and  because  they,  in  general,  cannot  be 
controlled,  the  consistency  from  one  session  to  another  can  be  severely  com¬ 
promised.  Variabilities  as  high  as  50%  are  often  cited  in  the  measured  MRT 
from  laboratory  to  laboratory  with  20%  variability  reported  at  any  one 
laboratory.34 

The  eye’s  detection  capability  depends  on  the  visual  angle  subtended  by  the 
image  size  and  the  distance  from  the  monitor  to  the  observer.  Although  the 
eye’s  contrast  threshold  is  usually  reported  as  J-shaped,  the  actual  shape  is 
very  dependent  on  the  noise  power  spectral  density.35-37  The  observer’s  ability 
to  see  a  specific  spatial  frequency  target  depends  on  the  noise  content  in  the 
neighborhood  of  that  spatial  frequency  (Fig.  4.38).  Low- spatial-frequency  noise 
components  interfere  with  detecting  low-frequency  targets,  mid-spatial-frequency 


Table  4.10  Measured  CTF  and  Calculated  MTF 
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Spatial  Frequency  Presented 
to  the  Eye  (cy/deg) 


Fig.  4.38  Expected  MRT  as  a  function  of  noise. 


noise  increases  the  contrast  threshold  curve  at  mid-frequencies,  and  so  on. 
When  considerable  white  noise  is  present,  the  eye’s  contrast  threshold  curve 
becomes  nearly  flat  from  0.5  to  20  cycles/deg. 

In  the  laboratory,  the  distance  to  the  monitor  is  not  usually  specified  nor 
limited  in  any  way.  To  maximize  detection  capability  (stay  on  the  minimum 
of  the  contrast  sensitivity  curve),  an  observer  subconsciously  moves  closer  to 
the  monitor  to  perceive  small  targets  (high  spatial  frequencies)  and  further 
away  to  see  larger  targets  (low  spatial  frequencies).  With  head  movement,  the 
observer  will  report  his  lowest  possible  threshold  for  all  spatial  frequencies. 
On  the  other  hand,  if  the  infrared  imaging  system  is  designed  for  a  specific 
application  in  which  the  observer  sits  a  fixed  distance  away  from  the  monitor, 
then  it  is  appropriate  to  restrain  head  movement  to  those  distances  that  are 
commensurate  with  the  operational  environment.  Therefore,  two  measurement 
conditions  are  possible:  (1)  allowing  the  observer  to  move  his  head  and  (2)  fixing 
the  head  in  space.  Head  movement  may  yield  different  MRT  values  than  if 
the  head  is  fixed,  depending  on  the  amount  of  nonuniformity  (low-frequency 
noise)  present. 

When  uniform  white  noise  is  present,  the  MRT  can  approach  zero  as  the 
distance  to  the  monitor  increases.1  The  phenomena  by  which  the  MRT  can 
approach  zero  as  the  spatial  frequency  approaches  zero  is  similar  to  the  blend¬ 
ing  of  ink  dots  in  a  half-tone  image.  With  printing,  there  are  no  grays  but 
rather  ink  dots  of  varying  sizes  that  are  below  the  eye’s  resolution.  The  eye 
blends  the  dots  into  a  gray  level.  Similarly,  if  the  noise  had  no  significant  low- 
frequency  components,  as  the  observer  moved  farther  and  farther  away,  the 
individual  noise  spikes  would  eventually  be  below  the  eye’s  resolution  and  the 
eye  would  blend  the  image  into  a  uniform  gray.  Because  the  observer  can 
optimize  both  the  system  and  display,  the  MRT  can  approach  zero.  However, 
performance  models16,38,39  were  developed  for  a  noise-limited  condition.  Mov¬ 
ing  a  substantial  distance  from  the  display  violates  the  model  assumptions. 
Although  MRT  may  approach  zero  for  extremely  large  viewing  distances  (in 
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excess  of  15  ft),  these  responses  may  not  be  considered  representative  of  actual 
system  usage.  The  MRT  low-frequency  asymptote  appears  to  depend  on  the 
amount  of  low-frequency  noise  present.  There  does  not  appear  to  be  a  universal 
scaling  factor.  However,  many  systems  appear  to  have  modest  low-frequency 
noise  such  that  the  MRT  asymptotes2’3  somewhere  between  0.3  and  0.7  times 
the  NEDT. 

Statistically  speaking,  at  threshold,  the  target  is  detected  50%  of  the  time 
by  one  observer  or,  equivalently,  detected  by  50%  of  the  population.  It  is  the 
variation  of  thresholds  (frequency  of  seeing  response)  that  accounts  for  the 
variation  in  detection  values.  The  broader  the  frequency  of  seeing  curve,  the 
larger  the  variation  in  individual  responses.  Observers  are  considered  "con¬ 
sistent”  if  their  threshold  value  does  not  change  on  a  periodic  basis  and  if  their 
frequency  of  seeing  curve  is  "narrow.”  To  appropriately  average  threshold 
responses,  it  is  necessary  to  understand  the  underlying  frequency  of  seeing 
distribution.  Holst  and  Pickard40  reported  an  experiment  in  which  76  observers 
detected  standard  four-bar  targets  of  various  spatial  frequencies  embedded  in 
noise.  It  was  determined  that  their  2700  detection  responses  could  be  math¬ 
ematically  described  with  a  log-normal  distribution.3  With  an  underlying  log¬ 
normal  distribution,  the  average  of  N  observations  is  the  geometric  average 
of  the  individual  MRT;  values: 


MRTave 


(4.38) 


Infrared  imaging  systems  are  subject  to  sampling  effects.  The  MRT  does 
not  have  a  unique  value  for  each  spatial  frequency  but  rather  has  a  range  of 
values  depending  on  the  location  of  the  targets  with  respect  to  the  sampling 
lattice.  As  a  result  of  phasing  effects,  it  has  become  widely  accepted  to  "peak 
up”  the  targets,  that  is,  to  adjust  the  targets  to  achieve  the  best  visibility  of 
the  targets.  It  is  important,  however,  that  the  observer  count  the  number  of 
bars  to  ensure  that  the  required  number  are  present.  Phasing  effects  dramat¬ 
ically  affect  the  appearance  of  the  bars  such  that  some  bars  appear  with  dif¬ 
ferent  widths  or  intensities.  In  the  region  of  0.6  to  0.8  times  Nyquist  frequency, 
no  matter  how  the  phase  is  adjusted,  the  bars  do  not  appear  equal  in  width  or 
intensity  (see  Fig.  4.37).  As  a  result  the  MRT  is  higher  in  this  region41  (Fig. 
4.39).  In  apparent  contradiction  to  sampling  theory,  it  is  possible  to  perceive 
four  bar  targets  whose  spatial  frequencies  are  about  10%  higher  than  the 
Nyquist  spatial  frequency.  If  an  infinite  number  of  bars  were  presented,  then 
it  would  be  obvious  that  the  input  spatial  frequency  was  aliased  down  to  a 
lower  spatial  frequency.  But  this  is  not  obvious  when  only  a  few  bars  are 


aA  log-normal  distribution  appears  as  the  usual  Gaussian-shaped  distribution  when  plotted  on  a 
logarithmic  axis.  Over  a  limited  region,  it  can  be  approximated  with  a  linear  Guassian  distribution 
with  the  same  mean.  The  standard  deviations  are  not  related.  The  log-normal  distribution  de¬ 
tection  threshold  follows: 


P(MRT)  = 


1 

V2tt  log(o-) 


f  1  [ log(MRT)  -  log(MRT) 

eXpi"2[ - - 


where  ct  =  1.58. 
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Fig.  4.39  MRT  for  a  staring  array.  The  anticipated  response  is  shown  with  a  solid  line. 
The  dashed  lines  are  the  experimentally  obtained  values  for  in-phase  (crosses)  and  out-of- 
phase  (circles)  targets.41 


presented.  It  is  possible  to  select  a  phase  such  that  a  four-bar  target  above 
Nyquist  can  be  reproduced  with  reasonable  fidelity. 

The  test  configuration  is  shown  in  Fig.  4.40.  Each  bar  of  the  four-bar  target 
has  a  7:1  aspect  ratio.  The  observer  is  allowed  unlimited  viewing  time  and 
can  continually  adjust  the  system  gain  and  level  to  optimize  the  image  for  his 
detection  criterion.  Likewise,  the  observer  can  adjust  the  monitor  contrast  and 
brightness  to  maximize  detection.  Usually  the  observer  adjusts  the  monitor  to 
a  relatively  low  brightness  level  and  a  relatively  high  contrast  level  to  make 
the  image  rather  noisy.  The  observer  is  permitted  to  readjust  the  system  and 
the  monitor  at  any  time.  The  ambient  lighting  should  approximately  match 
the  monitor  luminance.  The  observer  must  be  allowed  sufficient  time  to  dark 
adapt  to  the  reduced  ambient  lighting  before  proceeding  with  the  test.  It  is 
important  that  the  observer  not  be  influenced  by  the  environment.  This  in¬ 
cludes  extraneous  light  sources,  excessive  noise,  and  other  people  in  the  room. 

An  offset  between  the  actual  temperature  differential  and  the  measured 
temperature  differential  may  exist.  This  occurs  when  the  SiTF  does  not  pass 
through  the  origin.  This  offset  is  removed  from  the  final  MRT  value  by  ob¬ 
taining  the  MRT  for  both  positive  and  negative  contrast  targets  and  averaging 
the  results  together. 

The  entire  threshold  detection  versus  spatial  frequency  curve  should  be 
measured.  Because  a  discrete  target  set  is  used,  the  location  at  which  the  MRT 
asymptotes  to  infinity  may  not  be  measured.  The  curve  may  asymptote  between 
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Fig.  4.40  MRT  test  configuration. 


the  last  resolvable  target  and  the  next  available  target.  It  is  therefore  imper¬ 
ative  that  the  first  target  that  is  not  resolvable  be  recorded  as  CNR  (cannot 
resolve).  The  MRT  test  procedure  follows: 

1.  Position  the  target  with  the  bars  oriented  vertically  to  obtain  the 
horizontal  MRT  or  horizontally  to  measure  the  vertical  response. 

2.  Adjust  target  phase  for  maximum  visibility. 

3.  Verify  four  bars  are  visible  by  counting  them. 

4.  Establish  a  positive  sub-MRT  temperature  differential  and  slowly 
increment  the  blackbody  temperature  differential. 

5.  Allow  the  observer  to  continually  adjust  system  and  monitor  controls 
to  optimize  the  image. 

6.  Record  the  temperature  differential  at  which  the  observer  can  detect 
all  four  bars  50%  of  the  time. 

7.  Establish  a  negative  sub-MRT  temperature  differential  and  slowly 
decrement  the  blackbody  temperature  differential. 

8.  Allow  the  observer  to  continually  adjust  system  and  monitor  controls 
to  optimize  the  image. 

9.  Record  the  temperature  differential  at  which  the  observer  can  detect 
all  four  bars  50%  of  the  time. 

10.  Average  the  absolute  values  of  positive  and  negative  temperature 
differential  recordings  to  obtain  the  MRT. 
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11.  Repeat  for  other  spatial  frequencies. 

12.  If  a  target  cannot  be  resolved,  record  CNR. 

13.  Multiply  all  observations  by  the  average  collimator  transmittance 
and  average  atmospheric  transmittance  to  determine  the  effective 
source  intensity  at  the  entrance  aperture  of  the  infrared  imaging 
system. 

14.  Geometrically  average  the  individual  observer  responses. 

MRT  testing  takes  a  relatively  long  time  (up  to  several  hours)  depending 
on  the  number  of  observers  and  the  number  of  different  spatial  frequencies 
selected.  Ambient  temperature  conditions  can  often  change  over  this  long 
period  and  therefore  these  measurements  are  particularly  susceptible  to  am¬ 
bient  temperature  changes  (Fig.  4.9).  Because  of  the  potentially  large  fre¬ 
quency  of  the  seeing  curve,  it  is  important  to  state  the  number  of  observers 
required  in  a  specification  (Table  4.11). 


Table  4.11  Typical  Specifications 


The  MRT  shall  not  be  greater  than  0.5°C  (average  of  three  observations)  at  5  cycles/mrad 
when  the  ambient  temperature  is  at  20°C.  If  the  measurement  is  performed  at  another 
background  temperature,  a  correction  factor  must  be  applied  (system  specific). 
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5.1  INTRODUCTION 

This  chapter  examines  the  problem  of  automatic  video  target  tracking  and 
describes  design  solutions  based  on  modern  estimation  and  control  theory.  As 
tracking  system  technology  has  evolved,  it  has  progressed  from  designs  con¬ 
strained  by  hardware  limitations1  to  solutions  based  on  mathematical  models 
of  the  tracking  environment  and  sensor  data.  Using  the  tools  of  detection  and 
estimation  theory,2-4  improved  tracking  systems  can  now  be  developed  from 
such  models.  This  model-based  design  methodology5  is  the  foundation  on  which 
current  and  future  generations  of  video  tracking  systems  will  be  constructed 
and  evaluated. 

Automatic  video  tracking  systems  (AVTSs)  are  employed  in  a  wide  variety 
of  missions  and  tracking  environments.  They  are  used  in  numerous  applica¬ 
tions,  including  fire  control,  guidance,  navigation,  passive  range  estimation, 
and  automatic  target  discrimination  among  others.  As  a  consequence,  they 
tend  to  be  highly  specialized,  resulting  in  many  different  hardware  imple¬ 
mentations.  Rather  than  attempt  to  describe  a  multitude  of  hardware  config¬ 
urations,  this  chapter  focuses  on  the  basic  signal  processing  functions  that  are 
common  to  most  tracking  systems. 

Throughout  the  1970s  and  early  1980s,  a  major  challenge  confronting  au¬ 
tomatic  video  tracker  designers  was  the  need  to  implement  the  signal  pro¬ 
cessing  within  the  limited  capabilities  of  the  available  hardware.  Tracking 
algorithms  were  usually  implemented  directly  in  dedicated  hardware  and  were 
characterized  by  innovative  hardware  designs.  By  the  mid-1980s,  the  advent 
of  video  analog-to-digital  (A/D)  converters,  powerful  programmable  digital 
signal  processors,  and  very  dense  application-specific  integrated  circuits  al¬ 
leviated  many  of  these  hardware  constraints  and  shifted  the  design  focus  to¬ 
ward  software  solutions.6  As  a  result,  present-day  tracking  systems  are  dis¬ 
tinguished  from  their  predecessors  by  clever  algorithms  and  software  realizations. 
As  a  further  consequence  of  this  technology  migration,  modern  detection  and 
estimation  theory  now  play  a  central  role  in  the  design  of  AVTSs. 

The  symbols  and  nomenclature  used  in  this  chapter  are  listed  in  Table  5.1. 
Units  have  not  been  listed  because  most  of  the  symbols  represent  abstract 
mathematical  quantities  rather  than  physical  variables. 

5.1.1  Overview  of  an  Automatic  Video  Tracking  System 

The  purpose  of  an  AVTS  is  to  maintain  a  stable  sensor-to-target  line  of  sight 
(LOS)  automatically,  in  the  presence  of  both  relative  target  motion  and  base 
motion  disturbances  to  the  sensor  platform.  The  target  is  initially  located 
(acquired)  either  by  a  human  operator  viewing  a  display  or  by  some  form  of 
automatic  target  recognition  system.  After  the  target  is  acquired,  the  tracking 
subsystem  locks  onto  it  and  thereafter  maintains  the  LOS  autonomously. 

A  typical  AVTS  consists  of  three  major  components  (Fig.  5.1):  (1)  an  imaging 
sensor,  (2)  a  gimbal,  and  (3)  a  processor.  A  feedback  control  loop,  called  the 
track  loop ,  continuously  adjusts  the  gimbal  to  keep  the  target  in  the  center  of 
the  sensor’s  field  of  view  (FOV)  or  video  gate.  The  processor  closes  this  loop 
by  computing  the  pointing  error  commands  used  to  drive  the  gimbal.  These 
components  operate  in  the  following  sequence:  (1)  the  processor  locates  the 
target  signal  in  the  video  stream  generated  by  the  sensor,  (2)  the  processor 
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Table  5.1  Symbols  and  Nomenclature 


Symbols 

Nomenclature 

Az,El 

Azimuth  and  elevation 

B(0 

Background  object  plane 

bias 

Average  error 

CO 

Two-dimensional  sampling  function 

contrast 

Difference  between  average  target  and  background  intensity 

COV  matrix 

Covariance  matrix 

Known  or  measurable  functions 

e 

Error  vector 

E(-) 

Expected  value  operator 

eLos 

LOS  determination  error 

Cp 

Pointing  error 

Ek 

Innovation 

Css 

Steady-state  error 

et,eb,ed,ej 

Track,  bias,  drift,  and  jitter  error  vectors 

Et 

Average  per-pixel  target  image  energy 

CTL 

Target  location  estimation  error 

Cu 

Error  along  u  axis 

FI  matrix 

Fisher  information  matrix 

£e>  f& 

State  equations 

g 

Measurement  equation 

gu 

Gain  constant 

Gl,G2,G3,G4 

Adaptation,  LOS  determination,  loop  compensation,  and  gimbal 
transfer  functions 

Histi 

Interior  histogram 

Hist  t,  Hist  b 

Target  and  background  histograms 

HJk 

Cost  function  Hessian  matrix 

HOT 

Higher  order  terms 

KiJ) 

Pixel  intensity  at  (ij) 

IID 

Independent  identically  distributed  random  variables 

InttJntb 

Target  and  background  intensity 

J 

Cost  function 

Jk 

Cost  function  after  k  frames 

k 

Frame  number 

Kk 

Two-dimensional  correlation  surface 

/(•) 

Log-likelihood  function 

nc 

Composite  noise  variable 

n* 

Sensor  noise  plus  model  error 

Ng 

Total  number  of  pixels  in  gate 

na 

Random  pixel  noise  on  frame  k 

iV, (level), A/6(level) 

Number  of  target  and  background  pixels  with  gray  level 

Nt>Nb 

Number  of  true  target  and  background  pixels 
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Table  5.1  (continued) 


Symbols 

Nomenclature 

Nume 

Number  of  exceedances 

P(-) 

Object  plane  image  map 

Pl 

Probability  of  loss  of  lock 

Pr(ec|B) 

Probability  of  misclassifying  a  background  pixel 

Pr(e„|  T) 

Probability  of  misclassifying  a  target  pixel 

PSF(-) 

Point  spread  function 

Q(-) 

Target  indicator  function 

R 

Rotation  matrix 

Rg 

Gate 

zk 

Information  set 

Rk 

Target  reference  image 

Rt,Rb 

Target  and  background  regions 

Si,S2 

Scaling  parameters 

s 

Scale  matrix 

s* 

Sensor  image 

Std  Dev 

Standard  deviation 

SUMU,SUMV 

Weighted  index  summation 

(tU, tv) 

Target  location 

«:,<?) 

Target  location  optimizing  cost  function 

( tu  J  tv) 

Target  location  estimate 

(Ol 

Predicted  target  location  estimate 

T 

Translation  vector 

T(-) 

Target  object  plane  map 

Tf 

Frame  time 

T* 

True  target  image 

Totalt,  Totalb 

Number  of  pixels  classified  as  target  and  background 

var 

Error  variance 

VideoMapi) 

Pixel  intensity  to  binary  map 

^lgthjyigth 

Lengths 

#size  j^size 

Target  dimension  along  axes 

XuT 

Target  centroid,  u  axis  location 

Parameters 

0c 

Composite  parameter  vector 

level 

Pixel  gray  level 

X 

State  vector 

* 

Two-dimensional  convolution  operator 

(ij) 

Pixel  coordinates 

e 

Angle  of  rotation 

Wf,Wg,Wt 

State  noises 

©<,06 

Target  and  background  parameters 

2  2 
ruTSuB 

Radius  of  gyration  of  target  and  background  in  u  direction 

( continued) 
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Table  5.1  (continued) 


Symbols 

Nomenclature 

®r,©s 

Rapidly  and  slowly  varying  parameters 

dJ/d  tu 

Cost  sensitivity  along  u  axis 

dJ/dSi 

Cost  sensitivity  to  change  in  u  axis  scale 

ej 

Predicted  slowly  varying  parameters 

0C 

Estimated  composite  parameter  vector 

VJ* 

Cost  function  gradient  vector 

<r2 

Variance 

A 

Determinant 

Wl,Wf,Wi 

Weighting  functions 

Ux,Vy 

Standard  deviations 

0* 

Parameter  vector  optimizing  cost  function 

estimates  the  target  "state”  (described  later)  and  generates  the  gimbal  com¬ 
mands  based  on  state  information,  (3)  the  gimbal  command  is  applied  to  the 
sensor’s  LOS,  (4)  the  sensor  generates  a  new  video  stream,  and  (5)  the  process 
repeats. 

Although  the  three  identified  components  are  common  to  most  AVTSs,  each 
can  assume  any  of  several  forms  for  a  particular  application,  depending  on  the 
system  requirements.  For  example,  early  analog  centroid  trackers  employed 
analog  comparators  and  digital  counters  to  measure  or  estimate  the  location 
of  the  target’s  centroid  in  the  video  stream.  In  these  systems,  the  target’s  LOS 
was  based  solely  on  its  centroid,  and  the  control  law  was  implemented  by 
means  of  a  simple  proportional  control  loop.  In  contrast,  current  tracking 
systems  designed  to  track  ground  vehicles  moving  in  heavily  cluttered  envi¬ 
ronments  might  use  a  multimode  approach  based  on  correlation  and  centroid 
algorithms.  To  cite  another  example,  in  order  to  accommodate  the  high  dy¬ 
namic  rates  typically  encountered  on  airborne  platforms,  aircraft  navigation 


Gimballed  imaging  sensor 


Fig.  5.1  Imaging  sensor,  gimbal,  and  processor. 
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information  is  used7,8  as  ancillary  data  in  determining  the  LOS.  This  type  of 
system  requires  multiple  computers,  a  sophisticated  video  processor,  and  a 
high-speed  interface  to  the  aircraft’s  navigation  system. 

No  "universal”  tracking  system  design  exists  that  can  meet  the  performance 
requirements  specified  for  all  tracking  environments  of  interest.  Tracker  de¬ 
signs  tend  to  be  environment  sensitive.  For  example,  a  star  tracker  would  be 
virtually  useless  for  tracking  a  maneuvering,  noncooperative  target.  Similarly, 
an  up-looking  tracker  designed  to  track  airborne  or  spaceborne  targets  against 
a  sky  or  space  background  would  be  defeated  by  ground  clutter  if  it  were  used 
in  a  down-looking  surveillance  system.  It  is  therefore  essential  to  incorporate 
into  the  tracker  design  an  appropriate  description  of  the  expected  target  and 
background  characteristics.  Models  are  used  to  quantify  the  target  and  back¬ 
ground  characteristics.  Sections  5.2  and  5.3  describe  models  used  to  charac¬ 
terize  sensor  data  typical  of  various  target  and  environmental  parameters. 

5.1.2  Track  Loop  Architecture 

The  feedback  loop  implementing  the  tracking  system  is  inherently  nonlinear 
and  must  operate  with  uncertain  or  noisy  measurements.  To  simplify  the 
design  process  for  this  type  of  feedback  loop,  the  separation  principle9,10  from 
stochastic  control  theory  is  invoked.  This  principle  defines  a  control  architec¬ 
ture  that  separates  state  estimation,  based  on  the  sensor  data,  from  control 
law  generation  (Fig.  5.2).  The  advantage  of  this  separation  is  that  it  allows 
sophisticated  and  existing  design  procedures  to  be  applied  to  both  the 
estimation11,12  and  control  law9,13  aspects  of  the  design.  The  control  law  can 
then  be  based  on  the  principle  of  certainty  equivalence,4,10  which  replaces 
random  quantities  by  their  expected  or  average  values  during  the  control  law 
design.  This  simplification  converts  an  extremely  difficult  control  problem  into 
a  more  manageable  deterministic  control  law  design  problem.  Although,  strictly 
speaking,  this  is  suboptimal,  experience  shows  that  it  yields  good  tracking 
results. 

To  further  reduce  design  complexity,  state  estimation  is  divided  into  two 
parts:  (1)  target  location  estimation  and  (2)  LOS  determination  (Fig.  5.2).  Tar¬ 
get  location  estimation  analyzes  the  sensor’s  imagery  to  determine  the  position 


Fig.  5.2  Separation  principle  applied  to  track  loop  architecture. 
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FUR  scene 


Fig.  5.3  Target  gating  suppresses  clutter. 


of  the  target  in  sensor  coordinates.  This  is  an  image  processing  task  that  often 
requires  extremely  high  processor  throughput  rates.  The  target  location  es¬ 
timation  function  is  discussed  in  Sec.  5.2. 

The  target  LOS  determination  component14  utilizes  target  location  esti¬ 
mates  and  possibly  inertial  navigation  system  (INS)  data  to  determine  the 
target’s  state  for  use  by  the  track  loop  controller  (Sec.  5.4).  Methods  for  im¬ 
plementing  target  LOS  determination  can  vary  over  wide  limits,  depending 
on  the  operating  requirements.  For  example,  an  earthbound  sensor  designed 
to  track  slowly  moving  vehicles  might  simply  use  the  difference  between  the 
target’s  estimated  location  and  the  center  of  the  sensor’s  FOV  as  the  LOS  error 
criterion  for  the  gimbal  controller.  In  contrast,  a  tracker  that  is  required  to 
follow  maneuvering  airborne  targets  from  a  high-performance  aircraft  plat¬ 
form  might  utilize  the  aircraft’s  INS  to  compensate  for  sensor  platform  motion, 
and  a  Kalman  filter  to  make  high-quality  target  location  estimates.  (Nonimag¬ 
ing  sensor  data,  such  as  that  from  the  INS,  are  referred  to  as  ancillary  data.) 

The  target  location  estimate  is  often  computed  on  a  small  subimage  called 
a  target  gate  (or  simply,  gate).  Figure  5.3  depicts  a  typical  target  gate  sur¬ 
rounding  a  target.  By  processing  only  the  portion  of  the  scene  lying  inside  the 
target  gate,  the  effects  of  clutter  and  noise  on  the  tracking  process  are  largely 
suppressed,  resulting  in  a  more  robust  tracking  system.  Utilizing  just  the 
imagery  in  the  gate  for  target  location  estimation  also  helps  to  limit  the  pro¬ 
cessing  throughput  requirement.  As  a  rule,  the  gate  (which  is  usually  rectan¬ 
gular  or  square  in  shape)  should  have  the  smallest  dimensions  necessary  to 
completely  contain  the  target.8  Analyses  and  techniques  for  target  gating  are 
discussed  in  Sec.  5.4. 


flIn  sizing  the  gate,  some  allowance  must  be  made  for  jitter  and  other  angular  disturbances.  Under 
smooth  tracking  conditions,  however,  the  necessary  margin  is  normally  a  small  fraction  of  the 
gate  dimensions. 
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Fig.  5.4  General  tracking  system  architecture. 


The  primary  tracking  system  functions  are  shown  in  Fig.  5.2.  Additional 
secondary  functions  are  needed  to  support  the  primary  functions.  The  two  most 
important  secondary  functions  are  target  gate  determination  (which  supports 
target  gating  by  measuring  target  size)  and  the  breaklock  detection  function 
used  by  the  LOS  determination  component.  Figure  5.4  shows  the  general  track¬ 
ing  system  architecture,  including  both  primary  and  secondary  functions. 

It  is  not  uncommon  to  obtain  a  bad  target  location  estimate  from  a  failure 
of  the  target  location  estimator.  This  could  occur,  for  example,  if  the  target 
becomes  obscured  by  ground  clutter,  leading  to  an  unreliable  location  estimate. 
Obviously,  the  erroneous  target  location  data  generated  under  such  conditions 
should  not  be  used  in  determining  the  LOS.  The  breaklock  detection  function 
in  Fig.  5.4  is  used  to  sense  when  the  target  location  estimate  is  unreliable. 
This  ensures  that  erroneous  or  uncertain  data  will  be  ignored  by  the  target 
LOS  determination  function,  thereby  improving  track  loop  performance  under 
stressful  conditions. 

When  a  breaklock  condition  occurs,  the  tracking  system  can  continue  to 
point  the  gimbal  based  on  the  predicted  target  state.  In  this  "coast”  mode,  the 
track  loop  is  open,  i.e.,  the  pointing  axis  continues  to  move  in  the  direction 
and  at  the  rate  determined  by  the  last  target  state  estimate  before  breaklock. 
After  the  target  has  been  reacquired  and  a  reliable  target  location  estimate 
has  again  been  established,  the  breaklock  function  signals  the  LOS  determi¬ 
nation  function  to  resume  closed-loop  operation. 

Figure  5.4  illustrates  a  commonly  used  gimbal  control  technique  that  par¬ 
titions  the  control  function  into  LOS  stabilization  and  track  loop  compensation. 
The  LOS  stabilization  can  be  viewed  as  a  high-speed  inner  loop  working  in 
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conjunction  with  a  slower  outer  loop  that  incorporates  a  track  loop  compen¬ 
sator.  The  inner  loop  provides  relatively  high  bandwidth  closed-loop  stabili¬ 
zation  of  the  gimbal,  based  on  gimbal  position  and  possibly  accelerometer 
inputs.  Line-of-sight  stabilization  removes  (or  greatly  attenuates)  high-frequency 
sensor  platform  disturbances,  and  is  often  implemented  as  an  analog  signal 
processor.  The  track  loop  compensator  implements  the  outer  loop  compensation 
using  pointing  information  derived  from  sensor  imagery.  The  compensator 
operates  at  the  sensor  frame  rate,  which  is  much  slower  than  the  sampling 
rate  of  the  stabilization  loop.  Thus,  track  loop  compensation  is  typically  im¬ 
plemented  in  the  digital  processor,15  along  with  LOS  determination.  Section 
5.4  discusses  both  of  these  functions. 


5.2  TARGET  LOCATION  ESTIMATION 

Many  different  methods  of  target  location  estimation  have  been  developed. 
The  most  common  (and  probably  the  best  known)  of  these  is  the  centroid 
tracker.  Although  this  algorithm  works  well  in  some  tracking  environments, 
it  performs  poorly  in  others.  The  limitations  of  centroid  tracking  stem  fun¬ 
damentally  from  its  inability  to  fully  exploit  the  target  signature  information 
present  in  the  image.  To  overcome  this  deficiency,  maximum  likelihood  esti¬ 
mation  theory  can  be  invoked  to  identify  better  performing  target  location 
estimators.  It  will  be  shown  that  correlation  and  multimode  trackers  belong 
to  the  class  of  target  location  estimators.  These  trackers  are  often  required  to 
operate  in  highly  dynamic  clutter  environments. 

This  section  is  concerned  primarily  with  the  mathematical  foundations  on 
which  target  location  estimator  analysis  and  design  can  be  based.  Many  of  the 
details  needed  to  exploit  this  foundation  in  the  design  of  practical  tracking 
systems  are  beyond  the  scope  of  this  chapter. 

5.2.1  Centroid  Trackers 

5.2. 1 . 1  Binary  Centroid  Tracker.  Binary  centroid  trackers16  employ  the  im¬ 
age  processing  architecture  shown  in  Fig.  5.5.b  This  architecture  does  not 
require  high-speed  A/D  converters  or  high-performance  digital  signal  proces¬ 
sors  and  can  therefore  be  implemented  with  relatively  simple  hardware.  For 
this  reason,  the  binary  centroid  tracker  is  an  attractive  option  for  applications 
that  require  a  low-cost  tracker  with  only  modest  performance  capabilities.  Most 
early  imaging  trackers  used  this  architecture  because  high-performance  digital 
hardware  was  not  available. 

Consider  the  segmented  image  shown  in  Fig.  5.6,  where  each  pixel  has  been 
assigned  a  value  of  1  if  it  corresponds  to  the  target,  and  a  value  of  0  otherwise. 
The  binary  centroid  of  a  segmented  image  is  analogous  to  the  center  of  mass 
of  a  discrete  distribution  of  unit  masses.  If  the  video  map  (Fig.  5.5)  performs 
the  segmentation  by  assigning  a  value  of  1  to  each  target  pixel  and  a  value 


bBinary  centroid  trackers  are  also  called  silhouette  or  1-bit  trackers. 
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Fig.  5.5  Binary  centroid  tracking  architecture. 


of  0  to  each  background  pixel,  the  target’s  centroid  coordinates  (location  es¬ 
timates)  ( tu,iv )  within  the  target  gate  Rg  can  be  computed  directly  as  follows: 

;  _  SUMU  ;  _  SUMV 

u  Nume  ’  v  Nume  ’  {  ’ 

where 

SUMU  =  2  UiKiJ) 

(i,j)e.Rg 

SUMV  =  X  Vjl(iJ) 

( iJ)<ERg 


I(iJ)  = 


1  if  the  video  map  assigned  the  pixel  at 
(ui,Vj)  to  the  target 
0  otherwise 


Nume  =  X  KiJ)  =  total  number  of  threshold  exceedances 
(ij)GRg  (target  pixels)  in  the  gate 

Rg  =  region  lying  within  the  track  gate. 

For  the  example  in  Fig.  5.6,  the  total  number  of  exceedances  ( Nume )  is  91. 
The  weighted  index  sums  SUMU  and  SUMV  are  780  and  596,  respectively.  The 
binary  centroid  is  formed  by  normalizing  the  weighted  index  sums  by  the  total 
number  of  exceedances,  yielding  tu  =  780/91  =  8.57  and  tv  —  596/91  =  6.55. 
The  resulting  binary  centroid  position  is  indicated  in  Fig.  5.6. 

Because  /(.,.)  is  a  binary  variable  (1  or  0),  the  summations  SUMU ,  SUMV , 
and  Nume  can  be  performed  with  binary  adders.  Two  division  operations  then 
complete  the  calculation  of  tu  and  tv. 
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Fig.  5.6  Segmented  target  image. 


To  compute  the  target’s  centroid,  the  video  map  must  segment  the  target 
from  the  background.0  The  performance  of  the  binary  centroid  tracker  depends 
critically  on  the  ability  of  the  video  map  to  perform  this  task.  A  wide  variety 
of  video  maps  exist,  ranging  from  the  simplest,  implemented  by  a  single  thresh¬ 
old,  to  a  video  map  implemented  as  a  lookup  table.  For  the  simple  video  map, 
the  intensity  is  set  equal  to  1  if  it  exceeds  the  threshold  (an  exceedance)  and 
to  0  otherwise.  This  implementation  works  well  for  targets  that  exhibit  high 
contrast  with  respect  to  the  background.  On  the  other  hand,  a  single  threshold 
is  inadequate  for  bimodal  targets,  which  have  areas  of  both  positive  and  neg¬ 
ative  contrast.  Such  targets  require  a  more  complex  video  map. 

The  most  general  type  of  video  map  is  implemented  as  a  lookup  table.  A 
number  of  algorithmic  approaches  are  available  to  specify  the  elements  of  the 
table  adaptively.  One  representative  technique  based  on  intensity  histogram 
data  is  outlined  as  follows4: 


cThe  verb  to  segment  means  to  extract  the  target  from  the  background  on  a  pixel-by-pixel  basis. 
This  function  is  performed  by  the  processor  (see  Sec.  5.3.3). 

dAn  intensity  histogram  displays  the  number  of  observed  occurrences  at  a  series  of  increasing 
intensity  levels.  Histograms  are  often  used  to  estimate  a  probability  density  function. 
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VideoMap(\eve\)k+i  = 


C 


if  Histt( levels +  1  >  7 Histb (levels +1 
otherwise 


Histt(\evel)k+i  =  (l  ~  a)Histt(leve\)k  + 


Nt(\eve\)k 

Totalt 


Histb(\evel)k+i  =  (1  -  (levels 


+  P 


iVfcdevel)^ 

Totalb 


(5.2) 


where 


VideoMapi  •  )& 


(levels 


Hisfc  (levels 
IV*  (level)* 

iV&  (level)* 

Totalt 
Totalb 
a  and  p 

7 


level 


=  a  function  whose  domain  is  the  intensity  gray  levels 
and  whose  range  is  0  or  1  (binary);  it  is  applied  to 
the  image  at  frame  number  k 
=  normalized  target  histogram  at  frame  number  k\  the 
histogram  is  normalized  so  that  2  Histt( level)*  =  1 

levels 

=  normalized  background  intensity  for  the  k’th  frame 
=  number  of  occurrences  belonging  to  the  target  that 
have  the  specified  gray  level  in  the  fc’th  frame 
=  number  of  occurrences  belonging  to  the  background 
that  have  the  specified  gray  level  in  the  k'th.  frame 
=  total  number  of  exceedances  ( VideoMap  =  1) 

=  total  number  of  nonexceedances  ( VideoMap  =  0) 

=  parameters  that  govern  the  adaptation  rates  of  the 
target  and  background  histograms,  respectively 
=  another  parameter;  its  value  is  usually  determined 
experimentally  to  obtain  the  best  performance 
characteristics 

=  gray  level  or  pixel  intensity  value. 


In  the  video  map  algorithm  of  Eq.  (5.2),  the  results  of  the  target/background 
classification  were  used  to  develop  the  target  and  background  histograms.  But 
these  histograms  were  then  used  to  define  the  target/background  classification, 
via  the  video  map;  hence,  this  algorithm  is  circular,  i.e.,  the  decision  depends 
on  itself.  For  example,  if  pixels  were  classified  incorrectly  because  of  noise,® 
the  target  and  background  histograms  contain  errors.  As  a  result,  the  histo¬ 
grams  are  skewed  to  favor  the  classification  errors,  giving  rise  to  further  errors. 
In  this  way,  errors  continue  to  accumulate  until  the  video  map  no  longer  yields 
reliable  classifications,  resulting  in  poor  tracker  performance.  Clearly,  the 
buildup  of  error  in  a  circular  algorithm  must  be  tightly  controlled  if  the  al¬ 
gorithm  [Eq.  (5.2)]  is  to  be  useful  in  a  practical  tracking  system.  This  is  a 
major  problem  in  algorithm  design. 


eNoise  can  give  rise  to  two  types  of  pixel  classification  errors:  (1)  false  alarms  (exceedance  due  to 
noise  alone)  and  (2)  signal  dropouts  (target  signal  driven  below  threshold  by  a  negative  noise 
spike). 
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The  video  map  performs  target/background  classification  by  considering 
only  one  pixel  at  a  time.  Tracking  can  be  improved  by  including  information 
from  surrounding  pixels  to  reduce  misclassifications,  as  is  done  by  the  target 
segmentation  algorithms  discussed  in  Sec.  5.3.  A  segmentation  algorithm  used 
in  conjunction  with  the  binary  centroid  algorithm  can  improve  performance, 
but  this  expedient  tends  to  nullify  the  principal  advantage  of  the  latter  al¬ 
gorithm — its  relatively  simple  implementation. 

The  tracking  performance  of  the  binary  centroid  algorithm  can  be  quantified 
by  its  target  location  estimation  error  e(&),  which  is  the  difference  between 
the  estimated  location  of  the  target  in  the  object  plane  and  the  target’s  true 
location.  The  estimation  error  is  caused  by  sensor  noise,  and  therefore  is  treated 
as  a  random  variable.  Ideally,  a  random  variable  is  described  by  its  probability 
density  function,  but  because  the  true  density  function  is  seldom  known,  the 
location  error  is  characterized  by  its  mean  value  (or  systematic  bias)  and  its 
standard  deviation.17  If,  as  is  often  the  case,  the  probability  density  function 
can  reasonably  be  assumed  to  be  Gaussian,  then  these  parameters  completely 
determine  the  properties  of  e(k). 

In  general,  it  is  not  possible  to  completely  characterize  the  binary  centroid 
error  analytically  because  of  the  complex  nonlinear  function  involving  thresh¬ 
olds,  products,  and  divisions.  It  is  possible,  however,  to  generate  a  first-order 
performance  approximation,  as  in  Eq.  (5.3),  by  assuming  that  the  target  and 
background  can  be  characterized  by  uniform  intensityf  values  Intt  and  Intb , 
respectively  (Intt  ±  Intb),  and  that  the  pixel  noise  N (ij)  is  spatially  indepen¬ 
dent  and  identically  distributed  (IID).g  Because  the  approximation  can  be  very 
crude,  this  calculation  should  be  carried  out  in  conjunction  with  a  detailed 
simulation  analysis. 

If  S kd>j)  denotes  the  pixel  value  at  the  coordinate  position  (ij)  on  the  k’th 
frame,  then 

f Intt  +  N kdj)  if  (U)  belongs  to  the  target 
S  kdj)  =  \  t  ^^) 

l  Intb  +  N  kdj)  otherwise 

where 

S kdj)  =  pixel  value  (gray  level)  at  location  (ij)  for  frame  number  k 

Intt  =  target  intensity  (gray  level) 

Intb  =  background  intensity  (gray  level) 

N kdj)  ~  random  pixel  noise. 

When  Sk(iJ)  is  modeled  in  this  way,  it  can  be  shown  that  the  expected  value 
(or  bias)  and  the  variance  of  the  pointing  error  e(k)  can  be  approximated  as 

bias  =  E{eu(k)}  ~  -  ^~xut  Pr(ec|£)  ,  (5*4) 


fIn  radiometric  terminology,  the  concept  of  radiance  (or  stearance )  is  used  to  characterize  the 
radiation  signature  of  a  resolved  target,  as  well  as  the  background.  (In  this  context,  the  term 
intensity  is  reserved  for  unresolved  targets.)  When  dealing  with  a  spatially  quantized  image, 
however,  it  is  customary  to  describe  the  target  and  background  in  terms  of  their  equivalent  pixel 
intensities,  as  is  done  throughout  this  chapter. 
gThis  is  more  restrictive  than  spatially  uncorrelated  pixel  noise. 
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var{eu(£)}  -  ~{r2uT  Pr(ec|T)[l  -  Pr(ec|T)] 

J\lT 

+  Pr(ec|B)[l-  Pr(ec|fi)]} 

JMt 

where 


(5.5) 


eu(k) 


XuT  = 

Pr(ec|  B)  = 

Pr(ec|T)  = 

Ng 

Nt 

Nb 

TUT 


location  error  in  the  u  direction  based  on  the  data  in  frame 
k\  this  error  is  defined  to  be  the  difference  between  the 
centroid  algorithm’s  estimate  of  the  target  location  and  the 
target’s  true  centroid  location 
target’s  true  centroid  location 

probability  that  a  background  pixel  is  incorrectly  classified 
as  a  target  by  the  video  map 

probability  that  a  target  pixel  is  incorrectly  classified  as 

background  by  the  video  map 

total  number  of  pixels  in  the  gate 

number  of  true  target  pixels  in  the  gate 

the  number  of  true  background  pixels  in  the  gate 

radius  of  gyration  in  the  u  direction  for  the  target  within 

the  gate 


2 

ruT  = 


U  -  XuT )2 


ruB 


=  radius  of  gyration  in  the  u  direction  for  the  background 
within  the  gate 


2 

rUB  = 


U  -  Xut)2  • 


From  the  foregoing  definitions,  it  follows  that  Nt/Nq  is  the  percentage  of  the 
target  area  within  the  gate  and  Nb/Ng  is  the  percentage  of  background  within 
the  gate. 

Equations  (5.4)  and  (5.5)  approximate  the  location  error  in  the  u  direction. 
Similar  expressions  hold  for  the  v  direction. 

Assuming  that  the  sensor  noise  N k(ij)  consists  of  a  time  sequence  of  white 
noise  samples  and  that  the  video  map  does  not  change,  (ew(&)}  is  a  white  noise 
IID  sequence.  If  video  map  adaptation  is  permitted,  however,  then  the  sequence 
{eu(A0}  is  not  IID  as  a  result  of  correlation  through  the  video  map.  However, 
the  degree  of  correlation  is  often  weak,  so  that  {eM(&)}  can  be  approximated  as 
a  white  noise  sequence  when  analyzing  track  loop  performance  (Sec.  5.5). 

In  the  foregoing  analysis,  the  most  restrictive  assumptions  are  the  uniform 
intensity  of  the  target  and  the  background.  This  can  be  generalized  by  re¬ 
gionalizing.  Let  Rg,Rt ,  and  Rb  represent  the  regions  defined  by  the  target  gate, 
the  target  within  the  gate,  and  the  background  within  the  gate,  respectively. 
Partition  Rt  and  Rb  into  disjoint  (nonoverlapping)  subregions,  i.e., 

Rt  =  Rti  U  Rt2  .  .  •  U  Rtn  , 


Rb  —  Rb\  LI  Rb%  •  •  •  U  Rbm  5 
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where  the  pixel  intensities  associated  with  each  subregion  can  be  modeled  as 
a  constant  intensity  plus  random  IID  noise.  The  hypothesis  of  Eq.  (5.3)  is 
satisfied  in  each  subregion;  hence,  location  estimation  errors  associated  with 
each  subregion  are  approximated  by  Eqs.  (5.4)  and  (5.5).  If  it  is  further  assumed 
that  the  random  IID  noise  samples  associated  with  each  subregion  are  mutually 
independent,  then  the  subregion  error  characterizations  can  be  combined  to 
determine  the  bias  and  variance  of  the  target’s  location  error: 

m  Nb 

bias  =  E{eu(k)}  «  X  xuBt^r  Pr(ec|£;) 

i= i  nt 

n  Nr 

~  lxuTil^Pr{ec\ Ti)  ,  (5.6) 

i  =  i  Nt 

and 

var{e„(*)}  =  £  P>te|T.-)[l  -  Pr(ec| +  *2r,) 

Nt  i—1  N T 

1  m  Nb 

+  TT  2  Pr(ec|fi()[l  -  Pr(ec|Bi)]1rrJ(r^i  +  X\ )  ,  (5.7) 

Nt  i  Nt 

where  the  symbols  have  the  same  meanings  as  in  Eqs.  (5.4)  and  (5.5). 

Although  Eqs.  (5.6)  and  (5.7)  are  an  approximate  description  of  the  target 
location  error,  they  are  useful  for  studying  the  effect  on  centroid  performance 
of  varying  target  signatures  and  competing  clutter.  Here,  the  term  competing 
clutter  refers  to  areas  of  the  background  with  intensities  similar  to  that  of  the 
target,  making  it  difficult  for  the  video  map  to  distinguish  these  areas  from 
the  true  target.  Equations  (5.4)  and  (5.5)  also  provide  insight  into  the  effect 
of  variations  or  uncertainty  in  a  target’s  intensity  map.  For  example,  a  military 
vehicle  exhibits  a  different  thermal  signature  when  its  engine  compartment 
is  hot  than  when  it  is  cold. 

5.2. 1 .2  Intensity  Centroid.  The  architecture  of  the  intensity  centroid  is  sim¬ 
ilar  to  that  for  the  binary  centroid,  but  it  does  not  employ  the  video  map  to 
classify  target  and  background  pixels.18  Instead,  it  uses  intensity  information 
directly  in  the  centroid  calculation.  The  intensity  centroid  is  defined  by  the 
architecture  of  Fig.  5.5,  with  the  video  map  removed: 

s  SUMU  s  SUMV 

tu  =  - j -  ,  tv  =  j -  f 

It  It 

where 

(tu,tv)  =  intensity  centroid  estimate  of  target  location 

SUM  a  =  2  UiKi,j) 

(i,j)eRg 

SUMV  =  X  vjUiJ) 

( i,j)GRg 
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I(iJ)  =  pixel  intensity  at  location  (ui,Vj) 

It  =  X  I(xuyj)  =  total  intensity  over  the  target  gate. 

(iJ)GRg 

This  algorithm  can  be  implemented  efficiently  in  digital  signal  processor  ar¬ 
chitectures  that  have  access  to  array  index  values  within  their  pipeline. 

One  important  application  of  the  intensity  centroid  algorithm  is  high-accuracy 
point-target  tracking.  For  this  application,  the  sensor’s  optical  point  spread 
function  (PSF)  must  span  two  or  more  pixels  on  the  focal  plane.  If  the  PSF  is 
approximately  Gaussian  in  shape,  the  target’s  intensity  distribution  can  be 
characterized  by  a  two-dimensional  Gaussian  function.  For  this  distribution, 
the  target’s  binary  and  intensity  centroids  coincide.  If  the  binary  centroid  were 
used,  its  video  map  would  not  realize  any  benefit  from  the  high-intensity  values 
in  the  region  of  the  Gaussian  peak  because  this  algorithm  assigns  equal  weight 
to  all  target  pixels.  The  intensity  centroid,  on  the  other  hand,  makes  better 
use  of  the  target’s  signature  by  weighting  these  high-intensity  pixels  more 
than  the  lower  intensity  pixels.  This  results  in  better  pointing  accuracy  for 
the  intensity  centroid. 

The  accuracy  of  the  location  estimate’s  intensity  centroid  is  extremely  sen¬ 
sitive  to  the  size  of  the  target  gate.  In  the  previous  example,  if  the  gate  is 
large,  then  pixel  values  containing  mostly  noise  are  included  in  the  centroid 
calculation,  which  degrades  the  accuracy.  The  binary  centroid  was  found  to 
be  less  sensitive  to  noise  because  the  video  map  excluded  most  of  these  noisy 
pixels.  This  implies  that  the  accuracy  of  the  intensity  centroid  can  be  improved 
if  a  video  map  is  used  to  eliminate  pixel  values  not  clearly  associated  with  the 
target.  The  video  map  acts  like  a  pixel-level  gating  function  in  the  centroid 
calculation  of  Eq.  (5.8).  This  type  of  intensity  centroid  is  sometimes  called  a 
thresholded  intensity  centroid.  It  is  computed  from  Eq.  (5.8)  using  the  following: 

SUMU  =  2  UiU(i,j)]VideoMap[I{i,j)\  , 

(ifj)eRg 

SUM v  =  2  vj  [I ( i,j )]  VideoMap[I{  i,j )]  , 

( ij)  <E  Re 

It=  2  I(iJ)VideoMap[(I(iJ)]  . 

(iJ)E^Rg 


Approximate  analytic  expressions  for  the  location  error  of  the  intensity  cen¬ 
troid  and  thresholded  intensity  centroid  can  be  derived  in  a  manner  similar 
to  that  previously  used  for  the  binary  centroid.18  Taylor  expansion  and  re¬ 
gionalization  are  effective  analytic  techniques  for  the  intensity  centroids. 

To  illustrate  the  relative  target  location  estimation  accuracy  of  these  cen¬ 
troid  algorithms,  the  accuracy,  as  measured  by  the  standard  deviation  of  the 
error  value,  is  plotted  as  a  function  of  the  square  root  of  the  average  per-pixel 
energy  in  the  target  image  divided  by  the  standard  deviation  of  the  sensor 
noise.  This  is  one  form  of  SNR  for  target  imagery.  The  average  per-pixel  target 
image  energy  is  given  by 

Et  =  2)  I2d>jy( pixels  on  target)  . 

(ij)  e  target 
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Fig.  5.7  Binary  and  intensity  centroid  algorithm  performance:  (a)  Gaussian  intensity  dis¬ 
tribution  and  (b)  uniform  intensity  distribution. 


For  targets  with  uniform  intensity  distributions,  this  SNR  definition  becomes 
(target  contrast)/(sensor  noise  standard  deviation),  which  has  commonly  been 
used  in  specifying  tracking  systems. 

Figure  5.7  illustrates  the  accuracy  of  the  different  centroid  algorithms  for 
target  intensity  with  (a)  a  Gaussian  distribution  and  (b)  a  uniform  distribution. 
The  Monte  Carlo  runs  generating  this  figure  included  the  effects  of  spatial 
quantization  by  the  imaging  system  and  blurring  in  the  optics.  The  video  map 
was  implemented  by  a  simple  single  threshold.  No  attempt  was  made  to  op¬ 
timize  the  threshold  setting.  Furthermore,  in  this  example,  the  target  dimen¬ 
sions  were  a  small  fraction  of  the  gate  size,  so  the  accuracy  was  influenced  to 
a  significant  degree  by  the  background.  Gaussian  random  sensor  noise  was 
used  in  all  Monte  Carlo  runs. 

Comparing  Figs.  5.7(a)  and  5.7(b)  illustrates  that  accuracy  improves  as  SNR 
increases.  However,  the  curves  are  strongly  dependent  on  the  target’s  intensity 
distribution.  For  the  Gaussian  case,  Fig.  5.7(a),  the  binary  centroid  performed 
worse  than  the  intensity  centroids  because  it  does  not  take  advantage  of  the 
large  intensity  values  near  the  peak  of  the  intensity  distribution.  The  thresh- 
olded  intensity  centroid  splits  the  difference  between  the  binary  and  intensity 
centroids  because  thresholding  prevents  it  from  utilizing  target  intensity  val¬ 
ues  in  the  tails  of  the  Gaussian  intensity  distribution. 

For  the  uniform  target  intensity,  the  interrelationships  among  the  centroid 
accuracy  curves  change  completely.  The  binary  and  thresholded  intensity  cen¬ 
troids  outperform  the  intensity  threshold  because  they  suppress  background 
noise  through  thresholding.  The  thresholded  centroid  performs  slightly  better 
at  high  SNR  because  it  can  take  advantage  of  the  target’s  intensity  signature 
modified  by  the  optical  blurring  of  the  imaging  system.  The  thresholded  in¬ 
tensity  centroid  algorithm  exploits  the  slight  intensity  slopes  around  the  target 
boundary  more  effectively  than  the  binary  centroid. 
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Figure  5.7  also  illustrates  that  the  accuracy  of  centroid  target  location  es¬ 
timates  depends  on  how  effectively  an  estimation  algorithm  utilizes  the  target’s 
intensity  distribution  (target’s  signature).  Sections  5.2.2  and  5.2.3  address 
target  location  estimation  algorithms  that  are  explicitly  optimized  for  a  par¬ 
ticular  target  signature.  These  algorithms  are  capable  of  higher  accuracy  than 
the  centroid  algorithms. 


5.2.2  Maximum  Likelihood  Estimate  of  Target  Location 

Although  the  centroid  algorithms  perform  quite  well  for  simple  targets  in 
uncluttered  backgrounds,  a  more  powerful  target  location  estimator  is  needed 
for  more  stressful  environments.  The  maximum  likelihood  target  location  es¬ 
timator  is  one  such  example. 

The  maximum  likelihood  principle  (from  mathematical  statistics)  provides 
a  method  of  estimating  target  location  from  measured  data.3,5,10,12  The  max¬ 
imum  likelihood  estimate  (MLE)  of  a  target’s  parameters  is  obtained  by  max¬ 
imizing  the  likelihood  function,  which  is  the  conditional  probability  of  the 
measured  data  for  a  given  set  of  target  parameter  values.19’20  The  likelihood 
function  is  derived  from  the  overlay  model,  which  relates  the  target  parameters 
to  the  measured  data.  Because  the  tracking  algorithm  is  synthesized  from  the 
overlay  model,  maximum  likelihood  tracking  belongs  to  the  class  of  model- 
based  algorithms. 

Maximum  likelihood  tracking  is  optimal  in  the  sense  that  it  provides  the 
most  accurate  unbiased  estimates  of  the  target’s  location.  Even  though  the 
MLE  algorithm  frequently  cannot  be  directly  implemented  in  available  hard¬ 
ware,  it  serves  as  a  useful  reference  against  which  the  performance  of  other 
tracking  algorithms  can  be  gauged.  Thus,  in  a  simulation  study,  any  tracking 
algorithm  whose  performance  approaches  that  of  a  maximum  likelihood  al¬ 
gorithm  should  be  viewed  as  a  strong  candidate  for  implementation. 

As  a  rule,  accurate  mathematical  models,  such  as  the  overlay  model,  yield 
high-performance  target  tracking  algorithms.  But  the  price  of  this  superior 
performance  is  often  an  algorithm  that  is  complex  and  difficult  to  implement. 
To  improve  the  implementability  of  the  algorithm,  the  tracker  design  often 
entails  simplifying  the  overlay  model.  The  correlation  tracker  (Sec.  5.2.3)  is 
an  important  example  of  this  design  philosophy;  its  implementation  is  less 
computationally  intensive  than  an  algorithm  based  rigorously  on  the  overlay 
model. 

Another  way  of  improving  the  implementability  of  a  tracking  algorithm  is 
to  select  an  efficient  mathematical  optimization  algorithm.21  The  optimization 
literature  describes  a  variety  of  efficient  algorithms  applicable  to  real-time 
tracking. 


5.2.2. 1  Overlay  Model.  The  overlay  model  [Eqs.  (5.9)  to  (5.14)]  is  a  com¬ 
posite  of  five  interlinked  submodels:  (1)  a  submodel  of  the  open-loop  LOS  dy¬ 
namics,  (2)  a  target  parameter  submodel,  (3)  a  background  parameter  sub¬ 
model,  (4)  an  object  plane  submodel,  and  (5)  a  sensor  submodel.  Figure  5.8 
shows  the  architecture  of  the  overlay  model  and  the  linkages  between  the 
submodels. 
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Fig.  5.8  Architecture  of  the  overlay  model. 


Mathematically,  the  overlay  model  has  the  following  form: 


x{k  +  1)  =  f*[x(&),d f(k),k]  +  w f(k)  ,  (5.9) 

[u(k),v{k)]  =  g[x(fc),d g(k),k]  +  vrg(k)  ,  (5.10) 

St(k)  =  it[<dt(k)At{k\k]  +  wt(k)  ,  (5.11) 

@6(&)  =  fb[®b(k),db(k),k]  +  w b(k)  ,  (5.12) 

P(0c)  =  Q +  {1  -  Q[(u,v),®t]}B{®b)  ,  (5.13) 

SkdJ)  =  C(k,u)PSF*P(0c)  +  N kdj)  ,  (5.14) 

where 


x(k)  =  state  variable  characterizing  the  open- 

loop  pointing  system  dynamics  associated 
with  motion  of  the  target,  sensor 
platform,  and  gimbal  subsystems;  this 
variable  and  the  state  equation  modeling 
it  describe  the  target  LOS 

d,,d*,d6  =  known  functions  of  time;  these  functions, 

which  may  be  ancillary  (nonimage) 
measurements,  are  inputs  to  the  dynamic 
equations 

g  =  transformation  from  state  x  to  the  LOS 

in  the  sensor’s  object  plane  coordinates 
( u,v )  =  coordinates  of  the  sensor’s  object  plane 
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W f(k),  W g(k),  W t(k),  W bik) 


T*(0t) 

B  *(©*) 
Q[(«,i>),©t] 

P(0c) 

* 

PSF(u,v) 

C(u,v) 

N  kdj) 


S  k(ij) 

k(k  -  1,  2,  n) 


=  the  state  error  ("plant  noise”)  associated 
with  the  dynamic  equation  for  target 
LOS,  the  measurement  error  associated 
with  the  transformation  to  the  sensor’s 
object  plane,  the  state  error  associated 
with  the  dynamic  model  for  the  target’s 
parameters,  and  the  state  error 
associated  with  the  dynamic  model  for 
the  background  parameters,  respectively; 
it  is  assumed  that  these  are  mutually 
independent  white  noise  sources 
=  target’s  object  plane  intensity 
distribution  parameterized  by  0* 

=  background  object  plane  intensity 
distribution  parameterized  by  06 
=  target  indicator  function,  which  is  unity 
for  object  plane  locations  corresponding 
to  a  target,  and  zero  otherwise 
=  sensor’s  object  plane  image  formed  by 
overlaying  the  target  on  the  background 
=  two-dimensional  convolution  operator 
=  sensor’s  optical  point  spread  function 
including  the  detector  area  and  a  high- 
frequency  pointing  jitter  function 
=  two-dimensional  comb  or  sampling 
function;  this  function  converts  the 
continuous  representation  of  the  sensor 
data  to  sampled  pixel  values 
=  sensor  noise  associated  with  the  photon 
detection  process  and  modeling  errors;  it 
is  typically  assumed  to  have  Gaussian 
statistics  and  to  be  both  spatially  and 
temporally  uncorrelated 
=  intensity  value,  of  the  (ij)’th  pixel 
=  target,  background,  and  combined 
parameter  vectors  for  the  overlay  model 
with  0C  =  0*  U  06  and  target  location 
(tu,tv)  E  0* 

=  image  frame  number  corresponding  to 
the  sampling  times  ti,t29-9tn- 


The  first  dynamic  submodel  of  the  overlay  model  characterizes  the  open-loop 
LOS  behavior  of  the  pointing  system.  Equation  (5.9)  (the  state  equation)  models 
the  dynamics  of  the  target,  gimbal  set,  and  sensor  platform,  whereas  Eq.  (5.10) 
transforms  the  state  vector  x  into  the  sensor’s  object  plane  coordinates.  In  the 
language  of  control  theory,  this  submodel  is  the  plant  around  which  the  track¬ 
ing  system  closes  the  loop. 

The  second  submodel  characterizes  the  target.  The  target’s  signature  can 
be  parameterized  by  factors  such  as  size,  shape,  and  contrast.  These  variables 
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depend  on  (1)  range  changes  between  the  target  and  the  sensor  platform, 
(2)  rotation  of  the  sensor  platform  with  respect  to  the  target,  (3)  rotation  of 
the  target  with  respect  to  the  background,  (4)  target  signature  changes  re¬ 
sulting  from  changes  in  target  orientation,  and  (5)  heat  loading  of  the  target 
and  background  over  time.  A  common  feature  of  most  of  these  changes  is  the 
fact  that  the  signature  variations  occur  slowly  in  comparison  to  the  sensor’s 
frame  rate.  The  resulting  temporal  signature  correlation  (slow  changes)  can 
be  modeled  parametrically  by  difference  equations  [Eq.(5.11)].  For  this  reason, 
the  overlay  model  employs  difference  equation  submodels  to  characterize  the 
target’s  signature  variations.  The  same  rationale  is  applied  to  the  third  sub¬ 
model,  which  characterizes  the  background  [Eq.  (5.12)].  The  target  parameter 
and  background  parameter  submodels  are  uncoupled  because  they  arise  from 
physically  independent  sources. 

These  dynamic  submodels  represent  an  important  feature  of  the  overlay 
model.  Earlier  tracking  system  models  tended  to  be  static,  in  the  sense  that 
temporal  correlations  between  image  frames  were  not  modeled  explicitly  (cf., 
the  correlation  tracker  model  in  Sec.  5.2.3).  Explicitly  modeling  the  frame-to- 
frame  dynamics  using  the  open-loop  LOS  dynamic  submodel  and  the  target 
and  background  parameter  submodels  can  result  in  improved  tracking  system 
performance.  This  is  particularly  true  for  stressing  scenarios  that  include  ma¬ 
neuvering  targets. 

The  sensor’s  object  plane  is  characterized  by  the  fourth  submodel  [Eq.  (5.13)], 
which  overlays  the  target  onto  the  background.  (This  is  the  origin  of  the  name 
overlay  model.)  Although  its  nonlinearities  and  complexities  are  analytically 
troublesome,  the  overlay  does  permit  a  very  rich  characterization  of  the  target 
and  the  background.  For  example,  the  background  scene  may  contain  higher 
spatial  frequencies  than  the  target.  By  means  of  the  overlay  structure,  this 
difference  can  be  modeled  and  applied  to  the  tracking  analysis. 

This  submodel  contains  both  target  and  background  object  plane  represen¬ 
tations:  T(©*)  maps  the  target  parameters  into  the  two-dimensional  object 
plane  and  B(0&)  performs  a  similar  role  for  the  background.  The  target  in¬ 
dicator  function  Q[(u,iO,0^]  governs  how  the  target  and  the  background  are 
combined  into  the  scene  viewed  by  the  sensor;  Q[(w,y),0f]  can  be  partitioned 
into  the  product  of  two  parts.  One  part  depends  only  on  0f.  It  represents  the 
target  boundary  and  interior  and  is  zero  for  all  other  values  of  ( u,v ).  The  other 
part  of  Q [(m, a),©*]  represents  those  parts  of  the  background  that  obscure  the 
target.  It  is  zero  for  these  background  sections.  This  indicator  function  then 
is  capable  of  modeling  both  target  movements  on  a  fixed  background  and  partial 
obscuration  of  the  target  by  the  background. 

The  fifth  submodel  [Eq.  (5.14)]  represents  the  sensor  by  its  point  spread 
function22  (PSF).  The  pixel  intensity  map  is  modeled  as  the  spatially  sampled 
output  of  a  linear  filter  (the  PSF)  acting  on  the  object  plane.  Sensor  noise  and 
model  uncertainty  are  modeled  by  additive  pixel  noise. 

In  the  overlay  model,  the  target  is  completely  defined  parametrically  by  its 
parameter  vector  0*.  Typical  components  of  0,  might  include  the  target  po¬ 
sition  in  Az  (azimuth)  and  El  (elevation)  or  (u,v)  relative  to  the  sensor’s  bore- 
sight  axis;  the  average  radiance  contrast  of  the  target  with  respect  to  the 
background;  the  target’s  angle  of  rotation  0  about  the  LOS,  relative  to  a  con¬ 
venient  reference  orientation;  and  the  target  dimensions.  Figure  5.9  presents 
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Fig.  5.9  RST  transform  used  in  a  target  parametric  description. 


an  example  of  such  a  parametric  target  model.  Here,  an  intensity  template  is 
specified  and  the  target  parameters  modify  the  template  to  produce  the  target 
signature  in  the  sensor’s  object  plane.  This  approach  permits  the  use  of  a  simple 
parametric  model  to  describe  very  complex  objects.  It  also  illustrates  how  a 
target’s  parametric  description  can  be  built  up  from  templates.  Templates  can 
be  very  useful  in  target  signature  modeling  because  they  allow  signatures  to 
be  characterized  more  simply  than  by  explicit  mathematical  descriptions. 

The  two-dimensional  RST  transform23,24  used  in  Fig.  5.9  is  given  by  Eq. 
(5.14a).  This  parametric  form  can  be  extended  to  three-dimensional  transfor¬ 
mations.  In  this  model,  the  target’s  signature  on  the  left  side  of  Fig.  5.9  is 
modified  by  the  transformation  to  produce  the  intensity  map  in  the  object  plane. 
Note  that  in  this  process,  the  parameters  of  the  .RST'  transform  are  incorporated 
into  the  target’s  parameters. 

Io(u',vf)  =  contrast  I(u,v)  , 

where 

(u r\  _  cose  sin0  si  ol/u\ 

\v' )  -sin6  cose  0  S2j\u/  \tvJ 

6  =  angular  rotation  (5.14a) 

si  ,S2  =  scale  changes  in  the  u  and  v  directions,  respectively 
tu,tv  -  translations  in  the  u  and  v  directions,  respectively. 

For  LOS  control,  the  translation  components  (tu,tv)  are  the  output  parameters, 
whereas  the  other  symbols  denote  nuisance  parameters,  which  are  parameters 
other  than  the  desired  outputs;  usually,  they  must  be  determined  along  with 
the  translation  components.  For  the  preceding  parameterization,  the  param¬ 
eter  vector  <dt  =  (£u,^,si,S2,0,contrast)  would  be  estimated  from  the  sensor’s 
data  to  obtain  the  target  location  output  parameters  ( tu,tv ).  In  general,  an 
estimator  of  @c  is  developed  and  employed.  The  translation  component  of  @c 
is  extracted  for  the  target  location  estimate. 

5. 2. 2. 2  Maximum  Likelihood  Tracking.  The  maximum  likelihood  target 
location  estimate  is  obtained  by  finding  the  value  of  the  parameter  vector  ©c 
that  yields  the  maximum  value  of  the  log-likelihood  function  Z(@c)  =  ln[Pr(Z^|Oc)], 
where  Pr(  •  |  • )  is  the  conditional  probability  function  and  Zk  =  {Si(i,j)}; 
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(ij)  E  Rg(l  =  1,  2, ...,  k)  is  the  information  set  containing  the  pixel  intensities 
on  which  the  parameter  estimate  will  be  based. 

The  maximum  likelihood  estimate  of  the  target’s  location  for  a  broad  class 
of  target  and  background  models  has  the  following  properties3,5’12: 

1.  The  estimate  is  unbiased,  i.e.,  on  the  average  it  reports  the  true  target 
location. 

2.  The  estimate  has  the  smallest  variance  within  the  class  of  unbiased 
estimators,  i.e.,  no  estimator  that,  on  the  average,  reports  true  target 
location  has  better  accuracy. 

3.  The  estimate  can  be  represented  approximately  by  Gaussian  statistics. 
This  property  justifies  the  use  of  the  standard  deviation  to  characterize 
the  target  location  accuracy. 

A  number  of  mathematical  procedures  exist  for  maximizing  Z(0C).  Tracker 
design  involves  selecting  the  best  approach,  given  the  computational  con¬ 
straints  and  the  target  dynamics.  The  difficulty  that  must  be  overcome  in 
design  stems  from  the  complexity  of  the  interrelations  in  Eqs.  (5.8)  through 
(5.14).  One  way  of  dealing  with  this  problem  is  to  express  the  target  and 
background  in  terms  of  parameters  0r  that  change  rapidly,  such  as  the  trans¬ 
lation  parameters  ( tu,tv ),  and  other  parameters  05  that  change  slowly,  such 
as  the  target  size.  One  procedure  is  to  estimate  0r  based  on  the  previously 
determined  value  for  0S,  thereby  simplifying  the  optimization  problem.  Once 
0r  is  determined,  0S  is  updated,  treating  0r  as  a  constant.  This  form  of  stepwise 
optimization  reduces  the  computational  cost  of  the  MLE  target  location  estimate. 

The  method  can  be  formalized  by  defining  the  conditional  log-likelihood 
functions  Z(0r 1 0s)  =  ln[Pr(Zn|0r,0s)]  andZ(0s|0r)  =  ln[Pr(Zn|0r,0s)].  Because 
0S  changes  slowly  with  respect  to  the  sensor  frame  rate  0s(fc)  =  ®s(k  -  D, 
it  follows  that  Z(0r)  =  Z[0r|0s(&  -  1)].  This  implies  that  the  optimization 
problem  can  be  reduced  to  maximizing  the  simpler  conditional  log-likelihood 
function  Z[0r|0s(&  -  1)].  The  procedure  is  as  follows: 

Step  1.  Initialize  with  k  =  1  and  ®s{k  -  1)  set  to  a  priori  values  chosen 
to  be  close  to  those  of  the  actual  parameters. 

Step  2.  Obtain  image  frame  number  k. 

Step  3.  Optimize  /[0r|0s(fc  -  1)]  to  obtain  ®r(k).  a 

Step  4.  Optimize  /[0s|0r(&)l  to  obtain  the  update  Ss(k). 

Step  5.  Set  k  =  k  +  1  and  go  to  step  2. 

To  illustrate  the  method,  consider  a  high-performance  tracking  system  that 
uses  a  predictor/corrector  algorithm  derived  from  a  gradient  search  procedure 
to  optimize  the  conditional  likelihood  function.  Predictor/corrector  algorithms 
fit  in  well  with  the  preceding  procedure  to  yield  implementable  real-time  track¬ 
ing  algorithms.11,25 

For  this  example,  assume  06  is  the  empty  set  and  0;  is  defined  by  Fig.  5.8 
and  Eq.  (5.14a).  Assume  that  (1)  the  distance  (range)  from  the  sensor  to  the 
target,  (2)  the  contrast  between  the  vehicle  and  the  background,  (3)  the  target 
rotation  angle,  and  (4)  the  target  dynamics  change  slowly  compared  to  the 
sensor’s  sampling  rate.  The  parameters  0S  =  (si,S2,contrast)  will  then  change 
slowly  with  respect  to  the  target  location  0r  =  (tu,tv)-  Equation  (5.15)  gives 
the  predictor/corrector  equations  for  steps  3  and  4.  For  Eq.  (5.15),  assume  that 
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the  sensor  noise  Nkihj )  is  temporally  and  spatially  independent  with  a  Gaus¬ 
sian  probability  density  function.  To  limit  computational  requirements,  only 
a  single  step  in  the  gradient  algorithm  is  performed  for  each  new  image  frame. 
As  long  as  the  per-frame  target  movement  with  respect  to  the  LOS  is  not 
excessive,  little  error  will  be  introduced  by  this  approximation. 


*  del 

Step  3:  tu{k  4-  1)  =  tu(k  +  1)  +  yi  — 

Otu 


Step  4:  Si(k  +  1)  =  Si(k  +  1)  +  72^ 

as  1 


(5.15) 


[<B(jfe+i),fo(jfe+i)],0f(jfe+i) 


where 

tu  =  target  location  estimate  after  frame  k  +  1 

[tu(k  4-  l),iv(k  4-  1)]  -  predicted  target  location  based  on  frame  ( k ); 

the  target  dynamics  submodel  [Eq.  (5.11)] 
is  used  to  generate  both  [i^ik  4-  1),££(&  4-  1)] 
and  Ss(k)  from  [(iu(k),iv(k)]  and  Ss(k).  To 
save  processor  throughput  requirements, 

®s(k  4-  1)  is  usually  approximated  with 
0S(^). 

71 ,72  =  constants  usually  chosen  experimentally  to 

give  good  tracking  performance 

J  =  part  of  the  conditional  log-likelihood  function 

that  depends  on  0r: 

J  =  2  {S(U)  -  C(ii,u)[PSF  *  P(er,6s)]}2 

( i,j)eRg 


dJ/dtu 


=  rate  of  change  of  J  with  respect  to  tu  and  is 
given  by 


Ek+iiiJ) 


[^P(0r,6s)]/^^u 


=  innovation,  or  difference  between  the  sampled 
imagery  from  the  sensor  and  the  predicted 
irnagery  based  on  [i„(k  4*  1  4-  1)]  and 

4-  1)  given  by  Sk  +  i(iJ)  -  C(w,u)PSF  * 

p  k£(*  +  i)X(k  +  in,  &f(k  + 1)] 

=  rate  of  change  of  the  target's  object  plane 
intensity  with  respect  to  tu 
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dJ/dsx  =  rate  of  change  of  J  with  respect  to  scale 

parameter  si,  given  by 


[dP(0r,0s]/dsi  =  rate  of  change  of  P(0r,0s)  with  respect  to  scale 

parameter  s\\  can  be  determined  from  Eq. 

(5.14a). 

The  predictor/corrector  equations  for  tv(k  +  1),  S2,  and  contrast  can  be  deter¬ 
mined  in  a  similar  manner. 

One  reason  that  a  single-step  gradient  algorithm  such  as  Eq.  (5.15)  performs 
well  is  that,  for  a  large  class  of  practical  problems,  the  log-likelihood  surface 
is  quadratic  and  fairly  smooth  near  its  maximum.  Figure  5.10  shows  contour 
curves  for  a  typical  log-likelihood  surface  about  its  maximum  point.  Gradient 
optimization  generally  works  well  on  such  surfaces.  The  location  of  the  max¬ 
imum  can  also  be  found  by  evaluating  the  log-likelihood  function  at  a  number 
of  grid  points  such  as  those  indicated  by  x’s  in  Fig.  5.10,  and  then  fitting  a 
quadratic  surface  to  these  points.  This  procedure  is  an  alternative  to  the  predictor/ 
corrector  algorithm  of  Eq.  (5.15).  A  combination  of  these  two  approaches  is 
also  possible.  Surface  fit  is  used  to  provide  high-accuracy  target  location  es¬ 
timates,  and  target  nuisance  parameters  are  estimated  using  the  predictor/ 
corrector  algorithm. 


Fig.  5.10  Typical  log-likelihood  surface  near  the  peak. 
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5. 2. 2. 3  Maximum  Likelihood  Tracking  Performance.  The  performance  of 
maximum  likelihood  estimators  is  well  documented  in  the  literature,  where 
the  error  covariance  of  these  unbiased  estimators  is  shown  to  be  bounded  from 
below  by  the  Cramer-Rao  (C-R)  bound.3,4,12  Experience  shows  that  the  C-R 
bound  is  fairly  tight  and  therefore  represents  a  good  first  approximation  to 
the  tracking  accuracy.  The  C-R  bound  is  given  by  Eq.  (5.16)  in  terms  of  the 
Fisher  information.  Because  Fisher  information  relates  directly  to  tracking 
performance,  it  can  be  used  to  quantify  tracking  in  terms  of  the  overlay  model 
parameters.  The  impact  of  different  system  and  environmental  parameters  can 
therefore  be  evaluated  in  terms  of  this  parameter.26  Moreover,  because  Fisher 
information  is  monotonically  related  to  tracking  accuracy,  it  can  be  used  to 
optimize  the  system  in  the  same  way  that  the  SNR  is  used  in  communication 
system  design.  Fisher  information  serves  in  place  of  the  SNR  for  imagery. 

COV(0c)  =  £{[0C  -  0C][0C  -  0c]7)  S  [FI]-1  ,  (5.16) 

where 

©c  =  unbiased  estimate  of  ©c 

COV(0c)  =  covariance  of  ©c 

E{'}  =  expectation  operator 

[  ]T  =  transpose  of  matrix  in  the  brackets 

FI  =  Fisher  information  matrix  about  ©c,  defined  as  follows: 


The  utility  of  Eq.  (5.16)  is  illustrated  by  applying  it  to  the  assessment  of  target 
location  accuracy,  which  is  characterized  by  the  standard  deviation  of  tu  and 
tv.  If  tu  is  the  Tth  component  of  parameter  vector  ©c,  the  lower  bound  for  the 
standard  deviation  of  tu  [std  dev  (£u)]  is  given  by 

std  devUJ  >  [(FI)(-j)]V2  ,  (5.17) 

where  A(^)  refers  to  the  (i,i)  element  of  matrix  A.  A  similar  expression  exists 
for  the  standard  deviation  of  tv. 

For  a  few  interesting  tracking  cases  such  as  correlation  trackers,  it  is  pos¬ 
sible  to  obtain  an  analytical  expression  for  Fisher  information  directly  from 
Eq.  (5.16).  For  most  tracking  problems,  however,  numerical  evaluations  are 
necessary. 

5.2.3  Correlation  Trackers 

Direct  implementation  of  the  maximum  likelihood  approach  tends  to  be  com¬ 
putationally  intensive  because  of  the  number  of  nuisance  parameters  that  must 
be  determined.  One  way  to  reduce  the  computations  required  is  to  simplify 
the  overlay  model.  This  section  describes  the  class  of  correlation  trackers  that 
can  be  considered  as  maximum  likelihood  trackers  with  simplified  models. 
Correlation  trackers  tend  to  be  less  computationally  stressful  than  the  max¬ 
imum  likelihood  location  estimators  obtained  directly  from  the  overlay  model. 
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5.2.3. 1  Correlation  Tracker  Formulations.  If  the  following  assumptions  are 
made,  the  overlay  model  of  Sec.  5.2.2  can  be  simplified: 

1.  Within  the  gate  Rg ,  the  number  of  target  pixels  is  large  compared  to 
the  number  of  background  pixels.  This  allows  the  model  to  be  simpli¬ 
fied  by  eliminating  nuisance  parameters  associated  with  the  background. 

2.  Changes  in  target  contrast,  size,  or  orientation  from  frame  to  frame 
are  insignificant.  This  reduces  the  target  parameter  set  to  the  trans¬ 
lation  portion  (tu,tv)  of  the  RST  transform. 

3.  Target  spatial  frequencies  are  large  compared  to  the  bandpass  of  the 
sensor’s  modulation  transfer  function  (MTF).  This  allows  the  MTF  of 
the  overlay  model  to  be  approximated  by  the  identity  transfer  function. 
This  assumption  can  be  weakened. 

Based  on  assumptions  1  and  2,  the  overlay  model  reduces  to  the  following: 

S kdj)  =  C(H,a)PSF*T[0,(«]  +  N kdJ)  ,  (5.18) 

where  ©*(&)  =  (tUitv)  are  the  target  parameters. 

Assumption  3  allows  Eq.  (5.18)  to  be  further  simplified  to  Eq.  (5.19),  which 
is  the  correlation  tracker  model: 

Sk(ifj)  =  Tk(i  -  tuJ  -  tv)  +  n kdj)  .  (5.19) 

The  additive  noise  n kd,j),  which  is  assumed  to  be  IID  Gaussian  in  Eq.  (5.19), 
consists  of  two  components:  N kdj)  and  model  error.  Sensor  noise/pixel  inten¬ 
sity  uncertainty  N kd,j)  is  as  described  for  the  overlay  model  (Sec.  5.2.2).  The 
model  error  is  introduced  here  to  account  for  the  uncertainty  or  error  between 
the  underlying  structure  generating  the  data  and  the  simplified  correlation 
tracker  model  of  Eq.  (5.19).  The  model  error  component  accounts  for  errors 
arising  from  the  three  assumptions  that  were  used  to  simplify  the  overlay 
model.  It  is  difficult  to  determine  the  magnitude  of  the  model  error.  One  ap¬ 
proach  is  to  use  a  Monte  Carlo  simulation  to  assess  the  difference  between  the 
overlay  model  and  the  correlation  tracker  model. 

For  the  correlation  tracker  model,  the  maximum  likelihood  estimator  for 
target  location  can  be  derived  directly  from  Eq.  (5.19).  This  estimate  is 

given  by  the  relationship  in  Eq.  (5.20),  in  which  J k(tu,tv)  is  the  least-squares 
cost  function  that  quantifies  the  difference  between  the  image  S&(.,.)  and  the 
target  reference  R*(.,.).  Ideally  R*  =  T*,  so  the  target  reference  is  the  target’s 
signature.  The  maximum  likelihood  estimate  (*£,£*)  then  corresponds  to  the 
best  least-squares  fit  of  the  reference  to  the  sensor  image.  ’  ’ 

J (t*u,t*v)  =  2  [S -  R*(*  -  t*,j  -  t*)]2 

(i,j)eRs  (5  20) 

s  X  [S k(i,j)  -  R*(i  -  tu,j  ~  tv )]2  =  J k(tu,tv)  ■ 

(i,j)ERg 


Other  equivalent  and  useful  formulations  are  possible.  The  sum-of-squares 
differences  in  Eq.  (5.20)  can  be  expanded  as  in  Eq.  (5.21).  The  first  term  to  the 
right  of  the  equals  signs  is  the  cross-correlation  between  the  reference  and  the 
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image.  The  second  and  third  terms  on  the  right  are  the  total  energies  in  the 
reference  and  sensor  images,  respectively.  If  these  terms  do  not  depend  on  the 
target  location,  then  maximizing  the  cross-correlation  between  the  reference 
image  and  the  current  sensor  image  is  equivalent  to  minimizing  Eq.  (5.20). 
Thus,  the  target  location  estimate  (£*£*)  maximizes  the  cross-correlation  be¬ 
tween  the  reference  and  sensor  images,  accounting  for  the  name  correlation 
tracker. 


Jkit'Uilv)  ~  2  ^  Sk(i,j)R>k(i  tUij  tv) 

( i,j)<ERg 

+  2  [S k(iJ)f  +  2  [R k(ij)f  .  (5.21) 

(iJ)GRg  (iJ)^Rg 


In  Eq.  (5.22),  the  cross-correlation  is  expressed  as  a  discrete  two-dimensional 
filtering  of  the  image  with  the  target  reference.  Hence,  the  correlation  tracker 
can  also  be  regarded  as  a  matched  filter  in  which  the  target  location  estimate 
corresponds  to  the  peak  of  the  filter's  output,  and  the  reference  image  corre¬ 
sponds  to  the  match  filter’s  impulse  response. 

2  Sk(i,j)Rk(i  -  tu,j  -  tv)  =  S**R*  =  K*(<u,4,)  ,  (5.22) 

( i,j)eRg 

where  S&*R&  is  the  two-dimensional  convolution  of  S^(.,.)  and  R&(.,.),  and 
K k(tu,tv)  is  the  two-dimensional  correlation  surface  of  S&(.,.)  and  R^  (.,.). 

The  quadratic  loss  function  in  Eq.  (5.20)  is  a  direct  consequence  of  the 
Gaussian  noise  assumption.  If  the  difference  between  the  reference  and  the 
target  image  results  from  a  non-Gaussian  process  such  as  gamma  spikes  (com¬ 
mon  in  space-based  sensors),  the  quadratic  loss  function  may  degrade  perfor¬ 
mance.  According  to  the  Gaussian  model,  events  falling  into  the  tail  of  the 
distribution  will  occur  so  infrequently  that  a  large  weighting  can  safely  be 
assigned  to  them.  But  if  non-Gaussian  processes  are  present  (e.g.,  gamma 
events),  they  may  occur  with  sufficient  frequency  to  significantly  degrade  tracking 
accuracy29  when  coupled  through  large  weighting  factors.  The  use  of  more 
robust  loss  functions,  such  as  the  absolute  value  function  |.|  improves  tracking 
accuracy  in  these  environments. 

In  particular  cases,  there  may  be  reasons  to  prefer  one  formulation  over 
another.  The  least-squares  formulation  [Eq.  (5.20)]  is  sensitive  to  the  total 
energy  in  the  image.  Changes  in  energy  (or  contrast  values)  due  to  scintillation, 
fading,  or  gain  variations  associated  with  automatic  gain  control  (AGC)  can 
degrade  track  performance.  The  cross-correlation  and  the  matched  filter  for¬ 
mulations  are  largely  insensitive  to  image  energy  variations.  On  the  other 
hand,  if  image  energy  is  relatively  constant,  the  least-squares  formulation 
delivers  improved  tracking  performance. 

Selection  of  the  correlation  tracker  formulation  also  depends  on  the  compu¬ 
tational  environment.30,31  The  cross-correlation  and  the  matched  filter  formu¬ 
lations  both  work  well  in  a  pipeline  processor  supporting  a  multiply-accumulate 
pipeline.  The  least-squares  formulation  requires  a  three-deep  pipeline,  which  is 
usually  fabricated  in  a  subtract-multiply-accumulate  configuration.  If  the  number 
of  pixels  on  target  is  large,  the  two-dimensional  convolution  [Eq.  (5.22)]  can  be 
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implemented  efficiently  using  a  fast  Fourier  transform  (FFT)  processor.  The  matched 
filtering  is  then  performed  in  the  frequency  domain. 

The  correlation  algorithm  for  Eq.  (5.20),  (5.21)  or  (5.22)  can  easily  be  im¬ 
plemented  with  parallel  processing.  Parallel  processes  can  be  employed  to 
evaluate  discrete  points  on  the  correlation  surface  corresponding  to  a  particular 
target  location.  If  pointing  accuracy  requirements  are  not  stressing,  the  point 
of  maximum  correlation  can  be  used  as  the  track  point.  If  better  pointing 
accuracy  is  required,  the  target  location  can  be  found  by  interpolating  between 
points  on  the  correlation  surface. 

One  way  to  reduce  computational  requirements  is  to  use  an  on-line  version 
of  the  correlation  algorithm.32  Although  the  on-line  correlation  algorithm  ap¬ 
proximates  true  correlation,  its  tracking  accuracy  approaches  that  of  Eq.  (5.20). 
It  also  reduces  processing  latency  because  it  does  not  require  stored  imagery. 

To  understand  the  on-line  correlation  algorithm,  consider  the  tracking  pro¬ 
cesses  as  a  sequence  of  two  modes:  (1)  an  initial  convergence  mode  and  (2)  a 
steady-state  tracking  mode.  In  the  convergence  mode,  the  sensor’s  initially 
poor  pointing  accuracy  is  continually  improved  until  it  reaches  a  steady  state. 
In  the  steady-state  tracking  mode,  corrections  to  the  sensor’s  gimbal  are  usu¬ 
ally  small;  i.e.,  the  error  between  the  predicted  target  location  and  the  tracker 
algorithm’s  target  location  estimate  is  slight.  By  expanding  the  least-squares 
cost  function  Jk(tUftv)  in  a  Taylor  series  about  the  predicted  target  location, 
the  cost  function  can  be  expressed  explicitly  in  terms  of  the  true  target  location: 


=  J  kituytv)  +  V(tu,tv)Jk\(tP,tP)[(t*,t$) 

—  {tu>tv)\  +  2  ^(tu,tv)Jk\(tP,tP)[(tu,tv)  —  (tu,tv)]  +  HOT  , 

where 


(fX,f?) 

(tZytv) 

HOT 


=  true  target  location 
=  predicted  target  location 
=  gradient  of  Jk  with  respect  to  ( tUytv )  at  {tudv) 
=  Hessian  matrix  of  Jk  with  respect  to  (tu,tv)  at 
itPUytv) 

=  higher  order  terms. 


As  long  as  the  prediction  error  (*S,f?)  -  (f£,tf)  is  small  (which  is  usually  true 
in  the  steady-state  tracking  mode),  the  HOT  can  be  ignored.  If  the  Hessian 
matrix  is  approximated  by  a  constant  diagonal  matrix,  a  simplified  expression 
is  obtained  for  the  target  location  estimate: 


tt  =  t£  -  gu 


dJk 

dtu 


(t&tfr 


(5.24) 


where  gu  is  a  gain  constant  chosen  for  best  closed-loop  tracking  performance 
and  (dJk/dtu)\(tP,w  is  the  derivative  of  Jk  with  respect  to  tu.  This  derivative 
can  be  approximated  as 

X  sk(ij)Rk(i  -ts  +  i,j-  -  X  Skdjma  -  tuj  -  tS) . 

(.i,j)eRg  UJXERg 
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If  the  derivative  approximation  is  used,  the  on-line  correlation  algorithm  given 
by  Eq.  (5.24)  reduces  to  the  evaluation  of  two  points  on  the  correlation  surface: 

t*  =  tZ  +  gu  X  S*(ij)R*(i  -  tpu,j  -  tp)  -  gu 

(iJ)GRg 

x  x  Skiijma  -tpu  +  i  j  -  o  . 

(iJ)eRg 


A  similar  expression  holds  for  t* . 

The  assumption  on  which  this  algorithm  is  based  is  the  closeness  of  the 
predicted  target  location  to  (£*,£*).  This  condition  is  usually  satisfied  in  the 
steady-state  track  mode;  hence,  the  accuracy  of  the  on-line  formulation  is 
expected  to  be  close  to  that  of  the  complete  correlation  algorithm.  During  the 
initial  convergence,  however,  this  condition  can  be  violated,  reducing  the  ac¬ 
curacy  of  the  on-line  correlation  algorithm.  Moreover,  convergence  is  not  guar¬ 
anteed,  so  a  detailed  simulation  study  is  needed  to  establish  a  zone  of  convergence. 

5. 2.3. 2  Correlation-Tracking  Performance.  This  section  presents  a  perfor¬ 
mance  analysis  of  the  correlation-tracking  algorithm.  Because  the  correlation 
tracker  was  shown  to  be  a  particular  case  of  maximum  likelihood  estimation, 
all  analysis  methodologies  described  in  Sec.  5. 2. 2. 2  are  applicable  to  correlation 
tracking.  Section  5. 2. 2. 2  established  that  Fisher  information  could  be  used  to 
evaluate  the  accuracy  of  any  MLE  tracker.  For  correlation  tracking  with  IID 
Gaussian  noise,  the  analytical  expressions  for  the  Fisher  information  and  the 
error  covariance  are  given  by  Eq.  (5.25)  and  Eq.  (5.26),  respectively. 


(5.25) 


where 

Ng  =  number  of  pixels  in  the  gate  Rg 

cr2  =  variance  of  nk(i,j )  in  Eq.  (5.25);  the  noise  term  is 

assumed  to  be  temporally  and  spatially  independent 
with  a  Gaussian  probability  density  function 
dT/du,  dT/dv  =  rate  of  change  of  the  target  template  T(-,-)  in  the  u 
and  v  directions,  respectively. 


The  Cramer-Rao  bound  can  be  used  to  obtain  an  approximation  for  correlation 
tracking  algorithm  performance  from  Fisher  information: 


CO V(iu,tv)  ^ 


2 


> 


(5.26) 
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A  A 

where  COV(£tt>fc)  is  the  covariance  matrix  of  the  correlation  tracker’s  target 
location  estimate  (tu,tv)  and 


.  1 
{i,j)&Rg 


dT.. 
— (i,j) 
du 


-.2 


(iJ)^Rg 


dT 

dv 


H  -  Lsj£<u,][£<W)]} 


Equation  (5.26)  is  adequate  for  first-order  tracking  system  analysis,  but  it 
should  be  supplemented  by  a  quality  simulation  study  because  the  correlation 
tracker  model  [Eq.  (5.18)]  is  often  at  variance  with  measured  data. 


5.2.4  Adaptation,  Learning,  and  Drift 

The  tracking  models  described  in  Secs.  5.2.2  and  5.2.3  utilized  parametric 
descriptions  of  the  target  and/or  background  that  were  assumed  to  be  accurate 
within  certain  limits.  Any  uncertainty  in  these  parametric  models  was  in¬ 
cluded  in  the  noise  terms.  But  because  tracking  performance  degrades  as  the 
magnitude  of  the  noise  term  increases  (see  Secs.  5. 2. 2. 3  and  5. 2. 3. 2),  such 
uncertainties  are  a  source  of  tracking  error.  When  the  target’s  signature  cannot 
be  accurately  modeled  parametrically,  the  technique  of  target  signature  ad¬ 
aptation  or  reference  adaptation,  described  in  this  subsection,  can  improve 
tracking  performance. 

Reference  adaptation  is  usually  implemented  by  estimating  the  target’s 
predicted  intensity  distribution33  using  a  temporal  filter  on  previously  regis¬ 
tered  target  images.  Either  finite  impulse  response  (FIR)  filters  [Eq.  (5.27)]  or 
infinite  impulse  response  (HR)  filters  [Eq.  (5.28)]  can  be  used.  Weighting  func¬ 
tions  should  sum  to  unity  to  ensure  that  the  target  and  its  reference  have  the 
same  amplitude. 

m 

R*  +  i (i,j)  =  2  Wi(l)Sk-i(.i  -  ii,j  -  ji)  ,  (5.27) 

1=0 

m 

Rk+i(i,j )  =  Wf(0)8k(i  ~  ikj  ~  jk)  +  ^Wfd)fo-i(ij)  ,  (5.28) 


where 

^  =  estimated  target’s  signature  for  frame  number  k 

w /■(•)  =  weighting  function  for  the  FIR  filter 
w/(«)  =  weighting  function  for  the  HR  filter 

=  target  location  estimate  for  the  Z’th  image. 

In  choosing  the  weighting  function,  both  random  sensor  noise  and  the  rate  of 
change  of  the  target  signature  must  be  taken  into  account.  If  the  noise  level 
is  high  and  the  signature  changes  slowly,  then  a  weighting  function  with  a 
long  effective  time  constant  is  desirable.  On  the  other  hand,  if  little  noise  is 
present  and  the  target  signature  changes  rapidly,  tracking  performance  will 
be  improved  by  using  a  smaller  effective  time  constant.  The  effect  of  noise  on 
tracking  performance  can  be  seen  by  considering  the  instantaneous  noise  term 
nc  in  the  correlation  tracker  model  of  Eq.  (5.18).  This  term  can  be  regarded 
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as  the  sum  of  three  components.  The  first  component  depends  on  the  sensor’s 
random  noise  Ns,  the  second  depends  on  random  noise  in  the  adaptive  reference 
Nr,  and  the  third  models  target  signature  uncertainty  in  the  reference  Nu.  It 
is  reasonable  to  assume  that  the  three  terms  are  mutually  independent. 

n c(iJ)  =  N s(iJ)  +  N r(i,j)  +  N u(iJ)  ■  (5.29) 

A  simple  example  provides  some  insight  into  the  relationships  involved.  Con¬ 
sider  a  first-order  FIR  filter  for  the  adaptive  reference.  Assume  that  the  var¬ 
iability  of  the  target  signature  results  entirely  from  platform  roll — a  situation 
typical  of  some  fire-and-forget  missiles.  For  low  roll  rates,  a  smaller  filter 
parameter  is  preferable  because  it  reduces  the  effect  of  the  second  noise  term 
of  Eq.  (5.29),  and  the  low  roll  rate  does  not  produce  a  dominant  third  term.  If 
the  roll  rate  is  high,  tracking  performance  is  improved  by  setting  the  parameter 
to  a  larger  value.  An  algorithm  might  be  implemented  to  estimate  roll  rate, 
thereby  allowing  the  filter  parameter  to  adjust  dynamically. 

The  foregoing  analysis  addressed  tracker  performance  when  the  sequence 
of  input  images  is  perfectly  registered  (i.e.,  the  target  image  is  estimated 
perfectly).  Short  of  performing  complex  image  interpolations,34  image  align¬ 
ment  accuracy  is  limited  by  1-pixel  spatial  quantization  error.  This  implies 
that  reference  adaptation  always  entails  registration  errors.  The  impact  of 
registration  errors  is  aggravated  by  the  circular  nature  of  the  correlation 
algorithm  using  reference  adaptation.  The  circular  sequence  is  as  follows: 
(1)  the  adaptive  reference  is  used  to  compute  the  target’s  location,  (2)  the  com¬ 
puted  target  location  is  then  utilized  to  generate  the  reference  for  the  next 
frame,  and  (3)  the  cycle  repeats.  If  an  error  (such  as  a  registration  error)  occurs 
in  the  target  location  computation,  it  will  propagate  around  the  circular  loop 
and  accumulate.  Consequently,  errors  (including  registration  errors)  can  build 
up,  leading  to  loss  of  lock. 

Tracker  error  growth  resulting,  for  example,  from  misregistration  in  the 
adaptive  reference  algorithm  is  referred  to  as  tracker  drift.  A  human  observer 
would  see  the  tracker  cross  hairs  drift  slowly  off  the  target  until  loss  of  lock 
occurred.  Drift  rate  can  be  reduced  by  carefully  selecting  the  filter  parameters, 
but  it  cannot  be  totally  eliminated.  The  drift  error  and  random  reference  error 
are  linked  so  that  choosing  a  filter  parameter  value  to  reduce  the  drift  rate 
leads  to  an  increased  random  reference  error.  Unless  other  information  is 
utilized  to  correct  the  alignment  in  the  adaptation  process,  the  registration 
errors  continue  to  accumulate  and  degrade  tracking  performance.  Section  5.2.5 
describes  a  method  for  eliminating  drift  in  the  adaption  process. 

5.2.5  Multimode  Tracking 

Multimode  tracking  represents  a  synergistic  approach  that  utilizes  a  variety 
of  tracking  techniques  (centroid,  correlation,  etc.)  to  overcome  the  limitations 
inherent  in  any  single-mode  tracker.  The  multimode  philosophy  stems  from 
the  observation  that  certain  trackers  work  better  in  some  situations  than 
others,  and  the  best  overall  performance  can  be  achieved  by  incorporating 
several  algorithms  into  one  tracker.  Thus,  if  it  were  possible  to  determine  in 
advance  which  tracking  approach  would  work  best  for  a  particular  situation, 
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Fig.  5.11  Multimode  tracking  architecture  using  tracker  selection. 


optimum  tracking  performance  could  be  realized  by  selecting  it  in  that  situ¬ 
ation.  Figure  5.11  shows  a  multimode  tracker  architecture  based  on  this 
observation. 

Multimode  tracking  can  be  illustrated  in  a  typical  scenario  by  considering 
a  correlation  tracker  following  a  tank  that  is  firing  small,  very  bright  flares. 
The  correlation-tracking  algorithm  seeks  to  align  the  incoming  target  image 
with  the  reference  image  of  the  tank  (without  flares).  While  the  target  is  firing 
its  flares,  the  current  imagery  differs  significantly  from  the  model  inherent  in 
the  correlation  tracker.  Hence,  the  correlation  tracker  may  be  unable  to  achieve 
its  expected  tracking  performance.  The  binary  centroid  tracker,  on  the  other 
hand,  i^  relatively  insensitive  to  intensity  variations  that  occur  within  the 
target  image  (such  as  the  "hot  spot”  caused  by  the  flare),  whereas  the  video 
gate  suppresses  effects  due  to  changes  that  occur  away  from  the  target.  There¬ 
fore,  a  binary  centroid  whose  video  map  is  set  to  eliminate  the  hot  spot  should 
provide  satisfactory  track  performance,  even  while  the  flare  is  within  the  track 
gate.  The  multimode  tracker  would  use  the  correlation  algorithm  until  it  de¬ 
tected  the  presence  of  the  flare;  then  it  would  switch  to  the  centroid  algorithm 
until  the  flare  left  the  vicinity  of  the  target. 

The  design  challenge  for  this  type  of  multimode  tracker  is  the  selection 
algorithm.  Designs  for  this  algorithm  are  based  on  heuristic  rather  than  an¬ 
alytical  approaches.  The  heuristic  method  is  dictated  by  the  complexity  of  the 
target  and  background  characteristics.  The  dynamic  behavior  of  the  target 
and/or  background  must  be  taken  into  account  in  the  design  of  a  multimode 
tracker.  If  there  were  no  dynamic  changes,  a  multimode  solution  would  not 
be  necessary.  A  model  of  the  dynamic  behavior  is  needed  for  simulation  studies 
to  validate  heuristic  algorithms. 

If  the  correlation  tracker  model  [Eq.  (5.18)]  could  describe  the  sensor  data 
perfectly,  the  tracker  selection  block  should  then  select  the  correlation  tracker. 
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Fuser 


Fig.  5.12  Example  of  a  multimode  tracker  using  data  fusion. 


On  the  other  hand,  if  significant  errors  exist  between  the  sensor  data  and  the 
correlation  tracker  model,  track  performance  might  be  improved  by  choosing 
a  different  algorithm.  Thus,  the  key  to  the  tracker  selection  algorithm  lies  in 
examining  and  responding  properly  to  differences  between  the  model  on  which 
a  tracking  approach  is  based  and  the  true  sensor  data.  Complexities  in  the 
true  sensor  data  make  heuristic  approaches  attractive  for  the  selection  algo¬ 
rithm,  but  extensive  simulation  studies  are  needed  to  refine  it. 

An  alternative  approach  to  multimode  tracking  employs  data  fusion  to  com¬ 
bine  the  outputs  of  several  different  tracking  algorithms.25  For  example,  one 
version  of  a  multimode  tracker  uses  two  tracking  algorithms:  (1)  an  adaptive 
reference  correlation  tracker  and  (2)  a  binary  centroid-tracking  algorithm.  The 
adaptive  reference  correlation  algorithm  offers  nearly  optimal  performance 
but  suffers  from  the  drift  problem  described  in  Sec.  5.2.4.  The  centroid  algo¬ 
rithm,  on  the  other  hand,  has  no  appreciable  drift.  If  the  fusion  block  (Fig. 
5.12)  combines  the  target  location  reports  from  both  the  centroid  and  corre¬ 
lation  algorithms  to  define  the  target  location  estimate  used  to  update  the 
reference,  errors  do  not  accumulate  in  the  reference.  Thus,  the  multimode 
tracker  does  not  drift.  In  this  case,  the  centroid  algorithm  helps  to  overcome 
an  inherent  limitation  of  the  adaptive  reference  correlation  algorithm. 

5.2.6  Comparison  of  Target  Location  Algorithms 

A  number  of  different  target  location  estimation  approaches  have  been  pre¬ 
sented.  They  cover  a  wide  range  of  capabilities  from  simple  hardware  imple¬ 
mentations  to  extremely  accurate  algorithms.  It  is  difficult  to  make  simple 
generalizations  comparing  target  locations  without  becoming  inaccurate  and 
misleading.  However,  Table  5.2  does  provide  a  high-level  contrast  of  the  dif¬ 
ferent  target  location  algorithms  and  can  be  used  for  first-pass  algorithm  selection. 


280  IR/EO  HANDBOOK 


Table  5.2  Comparison  of  Target  Location  Algorithms 


Algorithm 

Target 

Background 

Performance 

Hardware 

Implementation 

Binary 

centroid 

Gray  levels 
significantly 
different  from 
background 

Prefer  uniform 
with  small  range 
of  gray  levels 

Easily  corrupted 
by  structured 
clutter 

Very  simple 

Intensity 

centroid 

High 

intensities 
relative  to 
background 

Should  be  uniform 
with  no  significant 
intensities  in  gate 

Very  good  for  some 
target  intensity 
distributions  and 
bad  for  others 

Simple 

Thresholded 

intensity 

centroid 

High 

intensities 
relative  to 
background 

Best  if  background 
intensities  are 
different  from 
target  intensities 

Can  be  very  good; 
more  robust  than 
other  centroid 
algorithms 

Simple 

Fixed 

reference 

correlation 

Known 

signature 

Best  against 
uniform  intensity 
distribution 

Very  high 
accuracy  but 
poorly  performing 
if  target  signature 
deviates  from 
expected  signature 

May  require 

moderate 

throughput 

Adaptive 

reference 

correlation 

Unknown 

signature 

Best  against 
uniform  intensity 

Very  high 
accuracy;  robust  to 
changing  target 
signature 

May  require  large 
throughput 

Multimode 

Unknown 

signature 

Can  include 
unknown 
structured  clutter 

Very  high 
accuracy;  no  drift; 
robust  to 
structured  clutter 

May  require  large 
throughput 

Maximum 

likelihood 

Characterized 

parametrically 

Characterized 

parametrically 

Excellent 

May  require  large 
throughput 

Because,  for  a  particular  tracking  application,  it  is  often  easy  to  modify  any 
one  of  the  target  location  algorithms  to  meet  requirements,  the  trade-off  should 
be  expanded  beyond  what  was  selected  on  the  first  pass. 

5.3  TARGET  GATING  AND  BREAKLOCK  DETECTION 

Target  gating  and  breaklock  detection  are  two  supporting  functions  that  help 
to  ensure  good  tracking  system  performance  over  a  wide  range  of  environments. 

The  target  location  estimation  algorithms  described  in  Sec.  5.2  presume 
that  the  target’s  intensity  distribution  is  characterized  in  a  way  that  differ¬ 
entiates  it  from  the  background.  If  this  characterization  deviates  substantially 
from  the  true  target  signature,  or  if  the  target  cannot  be  distinguished  from 
the  background  (e.g.,  because  of  clutter),  then  significant  error  in  the  target 
location  estimation  can  occur.  The  purpose  of  the  breaklock  function  is  to  detect 
such  conditions  and  prevent  erroneous  target  location  estimates  from  influ¬ 
encing  the  LOS  control,  thereby  improving  tracking  performance.  Section  5.3.4 
describes  approaches  to  breaklock  detection. 

Target  gating  has  two  purposes.  First,  it  limits  the  amount  of  pixel  data 
that  must  be  processed.  Because  the  target  gate  typically  covers  only  a  small 
fraction  of  the  sensor’s  image,  bus  and  processor  loading  is  reduced.  Second, 
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restricting  the  target  location  computation  to  the  target  gate  reduces  the  like¬ 
lihood  that  noise  and  competing  clutter  or  other  targetlike  artifacts  will  corrupt 
the  target  location  estimate. 

The  dimensions  of  the  target  gate  are  often  adaptable  to  accommodate  tar¬ 
gets  with  changing  sizes.  Selection  of  a  gate  adaptation  algorithm  is  a  critical 
step  in  tracking  system  design  because  the  target  gate  can  significantly  influ¬ 
ence  the  performance  of  the  tracking  system.  The  relationship  of  tracking 
performance  to  target  gating  is  the  subject  of  Sec.  5.3.1.  Sections  5.3.2  and 
5.3.3  present  an  overview  of  some  techniques  and  approaches  that  have  been 
found  useful  for  choosing  a  target  gate  algorithm. 

5.3.1  Gate  Construction  and  Track  Performance 

In  the  binary  centroid  tracker,  the  centroid  is  computed  only  over  the  target 
gate  Rg.  Hence,  errors  in  target  gate  sizing  can  influence  tracking  performance. 
For  example,  if  the  gate  is  smaller  than  the  target,  the  binary  centroid  will 
differ  from  the  true  area  centroid  because  the  target  area  outside  the  gate  is 
excluded  from  the  computation.  The  magnitude  of  this  error  is  proportional  to 
the  degree  of  undersizing.  Target  location  errors  can  also  be  caused  by  an 
oversized  gate. 

For  the  binary  centroid  tracker,  the  impact  on  target  position  accuracy  can 
be  estimated  using  the  results  of  the  regionalization  analysis  in  Sec.  5.2.1. 1. 
Figure  5.13  shows  the  predicted  impact  on  binary  centroid  track  accuracy  in 
the  presence  of  a  uniform  background  derived  using  methods  in  Sec.  5. 2. 1.1. 
Note  that  the  performance  drops  off  gradually  as  the  gate  size  increases,  be¬ 
cause  of  the  increasing  probability  of  noise  exceedances  as  more  nontarget 
pixels  are  enclosed  by  the  gate.  If  the  background  is  not  uniform,  an  increase 
in  gate  size  has  a  more  pronounced  impact  on  track  performance.  The  sensi¬ 
tivity  to  gate  size  for  specific  backgrounds  can  also  be  assessed  using  the  results 
of  Sec.  5. 2. 1.1. 


Fig.  5.13  Track  accuracy  as  a  function  of  gate  size. 
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Fig.  5.14  Track  sequence  illustrating  loss  of  lock  caused  by  improperly  sized  gate. 


The  impact  of  gate  size  on  the  performance  of  the  correlation  algorithm  is 
similar  to  its  effect  on  the  binary  centroid  algorithm.  Tracking  performance 
is  optimized  when  the  gate  most  closely  matches  the  target,  and  falls  off  as 
the  gate  is  either  increased  or  decreased  relative  to  the  optimum  size.  When 
the  gate  is  undersized,  tracking  jitter  is  increased  because  some  target  pixels 
are  excluded  from  the  target  location  computation.  Tracking  performance  also 
degrades  when  the  gate  is  oversized,  because  background  pixels  and  additional 
noise  then  influence  the  target  location  estimate.  As  a  rule,  the  gate  should 
include  the  edges  of  the  target,  which  usually  contain  a  large  intensity  gra¬ 
dient.  In  Sec.  5.2.3.2,  it  was  shown  that  tracker  performance  is  directly  related 
to  intensity  gradients  in  the  image. 

In  the  presence  of  a  uniform  background,  tracking  accuracy  falls  off  grad¬ 
ually  as  the  gate  is  increased  beyond  its  optimum  size.  In  a  cluttered  envi¬ 
ronment,  however,  tracking  performance  may  degrade  sharply  if  a  portion  of 
the  clutter  is  allowed  to  enter  the  gate.  This  phenomenon  is  best  illustrated 
by  an  example.  Figure  5.14  shows  a  tracking  sequence  employing  an  oversized 
target  gate  moving  past  a  large  clutter  object  whose  intensity  is  comparable 
to  that  of  the  target.  When  the  target  is  close  to  the  clutter  object,  the  target 
location  estimate  is  distorted  by  the  presence  of  the  clutter  pixels  included  in 
the  gate.  Eventually,  the  target  moves  away  from  the  clutter  object,  but  in 
the  meantime,  the  centroid  algorithm  has  locked  onto  the  clutter,  causing  loss 
of  lock. 

Methods  of  constructing  the  target  gate  can  be  divided  into  two  classes, 
based  on  the  target  location  estimation  algorithm  being  supported.  Class  1 
includes  target  location  algorithms  that  generate  their  results  in  a  single  pass 
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Fig.  5.15  Gate  geometry  for  a  single-pass  target  location  estimation  algorithm. 


over  the  sensor’s  image  data,  such  as  the  centroid  algorithm.  The  gate  for  this 
class  must  be  sized  to  ensure  that  it  includes  the  target,  with  an  allowance 
for  the  uncertainty  in  the  target  location  estimate.  Class  2  includes  algorithms, 
such  as  the  correlation  algorithm,  that  search  the  image,  point  by  point,  for 
the  target.  For  this  class,  the  gate  encompasses  only  the  pixels  needed  to 
determine  the  likelihood  that  the  target  is  at  a  particular  location. 

The  manner  in  which  the  gate  is  used  differs  significantly  between  the  two 
classes,  and,  as  a  result,  the  gate  construction  is  also  different.  The  difference 
centers  on  the  way  in  which  uncertainty  about  the  predicted  target  location 
is  utilized  in  the  gate  construction  process.  For  the  class  1  one-pass  algorithms, 
the  gate  must  be  expanded  to  include  the  uncertainty  in  the  target’s  predicted 
location.  Figure  5.15  illustrates  the  gate  geometry  for  this  class.  For  class  2, 
the  gate  size  is  not  influenced  by  uncertainty  in  the  predicted  location  of  the 
target.  Instead,  it  is  determined  directly  from  the  size  of  the  target’s  image, 
whereas  the  predicted  target  location  uncertainty  is  used  to  define  the  search 
grid,  as  shown  in  Fig.  5.16. 

Gate  construction  can  be  described  on  a  formal  basis  as  follows.  First,  let 
*igth(&)  and  yigth(&)  be  the  estimated  target  lengths  in  the  two  image  plane 
directions,  based  on  the  fc’th  frame  of  data.  Denote  the  predicted  target  location 
uncertainty  by  vx(k  +  1)  and  vy(k  +  1);  these  are  the  standard  deviations  of 
the  prediction  error  at  the  time  that  the  ( k  +  l)’th  image  frame  is  received. 

For  class  1  (single-pass  target  location  estimators),  the  gate  Rg ,  defined  as 
*size  by  ySize,  for  use  with  frame  k  +  1  is  given  by 

m 

tfsiZe  =  OLdx(k  +  1)  +  2  wix\gth(k  ~  i)  , 

i  ~  0 

m 

ysize  =  +  1)  +  2  my\gth(k  -  i)  , 

i  =  0 


(5.30) 
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Fig.  5.16  Gate  and  search  geometry  for  a  searching  target  location  estimation  algorithm. 


where  the  scale  factor  a  is  usually  a  value  between  2  and  6  to  ensure  a  high 
probability  that  the  entire  target  will  be  included  in  the  gate.  The  weighting 
function  {u;*},  normalized  so  2?=o  wi  =  1,  increases  monotonically  with  de¬ 
creasing  i,  so  the  most  recent  image  frames  are  weighted  more  heavily  than 
earlier  frames.  Performing  a  weighted  average  over  the  most  recent  m  4-  1 
image  frames  serves  to  reduce  the  sensitivity  of  the  target  length  computation 
to  estimation  errors.  This  reduction  in  sensitivity  exploits  the  fact  that  target 
size  tends  to  change  slowly  so  that  the  size  estimation  error  can  be  reduced 
by  averaging.  The  integer  m  should  be  based  on  the  rate  of  change  of  target 
size,  e.g.,  if  the  target  size  changes  rapidly,  then  a  smaller  value  of  m  is 
preferable  to  a  larger  one. 

Some  earlier  tracking  system  performance  problems  have  been  traced  to 
poor  gate  sizing,  particularly  in  a  high  noise  and/or  clutter  environment.  In 
these  situations,  inferior  target  gating  combined  with  a  poor  SNR  caused 
tracking  breaklock,  even  though  the  target  location  estimation  algorithm  was 
still  performing  well.  Algorithms  such  as  that  in  Eq.  (5.31)  can  improve  track¬ 
ing  performance  by  reducing  gate  sensitivity  to  noise  and  local  transient  clutter. 

For  class  2  (searching  target  location  algorithms),  the  gate  can  be  con¬ 
structed  using  an  approach  similar  to  Eq.  (5.31): 

m 

*size  =  2  lgth(&  -  i)  , 

i=1  (5.31) 

m 

I'size  =  2  Wyigthik  -  i)  , 


and  the  search  size  is  given  by 

^search  =  OL(Jx{k  +  1)  , 

J'search  =  OtC Ty(k  +  1)  . 


(5.32) 
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The  foregoing  equations  demonstrate  that  the  gate  sizing  process  must  account 
for  the  uncertainty  in  the  target  location  predicted  for  the  next  frame.  High- 
performance  on-line  prediction  methods,  such  as  Kalman  filtering,  provide 
estimates  of  both  the  predicted  value  of  the  target  location  and  its  standard 
deviation.  These  can  be  used  directly  in  the  gate  construction  algorithms  pre¬ 
viously  described.  The  relatively  high  computational  cost  of  the  full  Kalman 
filter  can  be  reduced  by  using  an  approximation  for  the  predictor,9  e.g.,  as¬ 
suming  that  the  target  remains  at  the  same  pixel  location  estimated  on  the 
previous  frame.  This  crude  approximation  for  the  target  location  prediction 
was  employed  in  earlier  tracking  systems.  Crude  location  predictions  have 
larger  standard  deviations  and  yield  larger  gate  sizes,  which  can  increase  the 
tracker’s  sensitivity  to  noise  and  clutter. 

Although  ax(k  +  1)  and  <ry(k  +  1)  are  determined  by  the  target  location 
prediction  algorithm,  the  target  length  estimates  xigth(&)  andyigth(^)  are  ob¬ 
tained  through  image  analysis,  which  is  discussed  in  Secs.  5.3.2  and  5.3.3. 


5.3.2  Target  Length  Estimation  Based  on  Histogram  Analysis 

If  the  edges  of  the  target  can  be  identified,  then  its  length  can  be  found  from 
the  edge  locations.  Because  of  the  relative  simplicity  of  the  hardware  imple¬ 
mentation  required,  many  early  tracking  systems  employed  the  technique  of 
histogram  analysis  to  locate  the  target  edges. 

One  example  of  histogram  analysis  for  target  edge  determination  is  based 
on  a  geometry  employing  three  gates.  These  gates  contain  (1)  the  target  only 
(interior  gate),  (2)  the  local  background  only  (background  gate),  and  (3)  both 
background  and  target  (edge  gate).  Histogram  data  is  collected  over  the  back¬ 
ground  and  interior  gates.  The  resulting  histograms  are  then  used  to  classify 
pixels  within  the  edge  gate.  If  the  interior-gate  histogram  value  of  an  edge- 
gate  pixel  is  larger  than  its  background-histogram  value,  the  pixel  is  classified 
as  a  target  pixel,  because  its  intensity  more  closely  matches  that  of  the  target. 
Otherwise,  the  pixel  is  classified  as  a  background  pixel.  The  location  of  the 
target  edge  is  then  determined  from  the  fraction  of  target  pixels  in  the  edge 
gate.  Figure  5.17  illustrates  this  gate  geometry  and  the  estimated  edge  location 
based  on  this  algorithm. 

A  formal  description  of  this  algorithm  is 


offset  = 


s 

edge  gate 


1  if  Histi[Sk(iJ)]  >  Histb[Sk(iJ )]j 
0  otherwise  I 


number  of  pixels  in  edge  gate 


(5.33) 


where  Histi(-)  and  Histb(-)  are  the  interior  and  background  histograms, 
respectively. 

Because  this  edge  algorithm  uses  fewer  target  pixels  than  are  used  in  the 
target  location  estimator,  it  is  also  noisier  than  the  latter.  Moreover,  because 
poor  target  gating  reduces  the  accuracy  of  the  target  location  estimate,  it 
follows  that  tracking  performance  may  be  limited  by  the  accuracy  of  the  target 
edge  determination.  Hence,  in  tracking  system  design,  care  must  be  exercised 
to  minimize  the  noise  associated  with  the  edge  algorithm. 
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Fig.  5.17  Gate  geometry  for  target  edge  location. 


Noise  effects  can  be  minimized  in  several  ways.  First,  the  noise  reduction 
can  be  achieved  by  increasing  the  size  of  the  edge  gate.  But  this  improvement 
is  offset  by  the  fact  that  a  larger  edge  gate  may  also  reduce  the  accuracy  of 
the  estimate,  because  more  background  or  clutter  will  be  included  in  the  com¬ 
putation.  Another  method  of  increasing  noise  immunity  involves  the  interior 
and  background  histograms.  Because  typically,  the  background  and  target 
signatures  do  not  change  rapidly,  the  accuracy  of  the  histograms  can  be  im¬ 
proved  by  averaging  over  a  number  of  previous  sensor  image  frames. 

The  target  gating  approach  previously  described  is  predicated  on  the  as¬ 
sumption  that  the  target  size  and  intensity  distribution  are  relatively  static. 
In  certain  severe  tracking  environments,  however,  this  assumption  is  not  valid. 
For  example,  a  jinking  aircraft  produces  an  image  whose  size  and  shape  re¬ 
peatedly  undergo  sudden  changes.  To  deal  with  such  cases,  the  target  gating 
approach  can  be  supplemented  with  a  target  size  model  (part  of  the  overlay 
model).35  Another  potential  limitation  of  this  approach  concerns  the  shape  of 
the  target.  The  gating  algorithm  works  well  for  blunt-edged  targets  and  poorly 
for  targets  with  long  sloping  edges. 

If  the  edge  algorithm  cannot  perform  reliable  target  edge  gating,  then  it 
may  be  necessary  to  employ  sophisticated  image  processing  algorithms  from 
automatic  target  recognition  to  determine  the  target’s  boundary.  These  meth¬ 
ods  are  described  in  Sec.  5.3.3. 

5.3.3  Target  Segmentation 

Target  gating  is  similar  to  the  problem  of  target  segmentation  in  automatic 
target  recognition  (ATR)  systems.  Target  segmentation36’37  classifies  pixels 
into  one  of  two  categories:  target  or  surrounding  background.  In  this  way,  the 
target  is  "segmented”  from  the  background.  In  ATR  systems,  this  technique 
is  used  to  obtain  target  shape  information  for  discrimination  purposes.  In 
tracking  systems,  the  target  gate  can  be  obtained  directly  from  the  segmented 
target. 
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A  number  of  very  sophisticated  target  segmentation  algorithms  have  been 
developed  in  recent  years.  Two  image  processing  techniques  commonly  used 
in  target  segmentation  are  edge  following  and  region  merging.  If  the  target 
edges  can  be  identified,  then  its  perimeter  can  be  determined  by  following  the 
edges  around  the  target.  Region  merging  divides  the  subimage  containing  the 
target  into  regions  (or  blobs)  based  on  intensity  and/or  texture.  These  regions 
are  then  merged  together  using  a  decision  tree  to  obtain  a  set  of  regions  that 
define  the  target.  The  literature  contains  many  other  segmentation  algorithms. 

In  automatic  target  recognition  systems,  target  segmentation  must  be  car¬ 
ried  out  before  recognition  can  be  achieved.  For  tracking  systems,  because 
segmentation  is  used  only  to  determine  the  target  gate,  it  can  be  executed  in 
a  background  mode.  The  target  gate  usually  does  not  change  rapidly,  so  seg¬ 
mentation  results  from  previous  frames  can  be  used  in  the  current  frame’s 
target  location  estimation.  Furthermore,  unless  the  target  size  is  changing 
rapidly,  the  segmentation  algorithm  need  not  execute  after  every  frame  of 
sensor  data.  Because  target  segmentation  tends  to  be  computationally  inten¬ 
sive,  activating  it  in  the  background  mode  every  few  seconds  unburdens  the 
processor. 

Another  difference  between  the  use  of  target  segmentation  for  automatic 
target  recognition  and  for  tracking  stems  from  the  ability  of  a  tracking  system 
to  enhance  the  image  SNR.  The  SNR  has  a  direct  bearing  on  the  segmenter’s 
performance.  Because  the  tracking  system  updates  the  target  location  estimate 
on  each  frame,  the  image  SNR  can  be  enhanced  by  averaging  several  properly 
registered  (aligned)  frames,  using  the  target  location  estimate.  For  this  reason, 
a  segmentation  routine  that  would  prove  unsatisfactory  for  automatic  recog¬ 
nition  of  a  faint  target  may  perform  well  for  tracking. 

5.3.4  Breaklock  Detection  Algorithms 

One  way  to  gauge  the  performance  of  a  tracking  system  is  to  assess  the  ro¬ 
bustness  of  the  track  loop  to  changes  in  the  target  and/or  background  char¬ 
acteristics.  Examples  include  signature  changes  that  occur  when  (1)  the  target 
expels  a  flare  as  a  countermeasure  and  (2)  the  target-to-background  contrast 
decreases  to  a  very  low  value.  In  both  of  these  examples,  a  breakdown  of  the 
target  location  estimation  is  likely  to  occur.  Such  a  breakdown  can  lead  to 
track  loop  failure  (breaklock)  if  it  is  not  detected  and  compensated  for.  In  at 
least  some  cases,  a  breaklock  algorithm  can  be  devised  that  will  detect  a 
breakdown  condition  just  before  the  target  location  estimator  becomes  unre¬ 
liable.  By  disconnecting  the  unreliable  target  location  estimator,  the  robust¬ 
ness  of  the  track  loop  is  enhanced. 

The  design  of  a  high-quality  breaklock  algorithm  is  complicated  both  by  the 
random  noise  present  in  the  sensor’s  output  and  by  the  wide  variety  of  potential 
breaklock  conditions.  Because  the  conditions  that  the  breaklock  algorithm 
must  protect  against  are  often  complex,  heuristic  approaches  to  breaklock 
algorithm  design  have  usually  been  adopted.  Sometimes  this  results  in  a  crude 
algorithm  that  declares  a  breaklock  condition  prematurely,  i.e.,  before  the 
target  location  estimator  actually  becomes  unreliable.  A  breaklock  algorithm 
that  behaves  in  this  way  limits  the  performance  of  the  entire  tracking  loop. 
A  breaklock  algorithm  may  also  prove  unsatisfactory  because  it  does  not  in- 
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dicate  when  the  target  location  estimator  has  become  unreliable.  Careful  anal¬ 
ysis  is  required  to  balance  the  competing  goals  of  reliable  breaklock  detection, 
robustness  against  breaklock,  and  algorithm  complexity. 

One  heuristic  approach  involves  a  set  of  confidence  parameters  associated 
with  the  target  location  estimation  process  (Fig.  5.11).  These  confidence  pa¬ 
rameters  are  usually  chosen  for  situations  that  have  caused  problems  in  pre¬ 
vious  tracking  systems.  For  example,  it  is  known  that  a  high-clutter  back¬ 
ground  can  cause  a  centroid  tracker  to  breaklock.  To  improve  tracking 
performance  under  such  conditions,  a  confidence  parameter  keyed  to  the  stan¬ 
dard  deviation  of  the  background  might  be  employed.  If  the  standard  deviation 
was  found  to  exceed  a  predetermined  value,  the  confidence  parameter  would 
be  lowered. 

Another  breaklock  detection  technique,  which  is  based  on  classical  detection 
theory,  utilizes  the  model  developed  for  the  target  location  estimation  algo¬ 
rithm.  As  described  in  Sec.  5.2.2,  the  estimate  generated  by  the  target  location 
algorithm  is  based  on  the  best  fit  of  the  model  to  the  sensor’s  data.  The  degree 
of  fit  can  be  regarded  as  a  measure  of  how  well  the  target  location  estimation 
algorithm  is  performing,28  and  it  can  be  used  as  a  confidence  parameter  for 
breaklock  detection.  In  the  tank-expelling-a-flare  example,  the  model  (which 
does  not  include  the  flare)  will  be  at  variance  with  the  image  provided  by  the 
sensor.  The  existence  of  a  large  residual  difference  between  the  real  image 
and  the  model  then  indicates  a  breaklock  condition. 

This  approach  can  be  expressed  mathematically  using  the  sensor’s  data 
model: 

S  =  M(©*)  +  N  ,  (5.34) 


where 

S  =  sensor  data 

M(-)  =  mathematical  model  used  for  estimating  the  target’s  location 
0*  =  best-fit  parameter  vector  containing  target  location 

N  =  all  the  noise  components  contained  in  the  system  affecting  the 
sensor  data,  including  characteristics  not  represented  by  M(-). 

The  breaklock  test  is  formed  by  summing  the  square  of  the  residuals  over  the 
target  gate: 


2  [S(iJ)  -  M(ij)|q*]2 

(iJ)eRg 


f  >  Thr  =>  Breaklock 
\  <  Thr  =>  No  Breaklock 


(5.35) 


This  test  can  often  be  performed  with  little  extra  computational  loading  be¬ 
cause  the  summation  can  be  performed  as  part  of  the  target  location  estimation 
algorithm.  Implicit  in  this  breaklock  algorithm  is  the  assumption  that  the 
noise  N  is  Gaussian.  If  this  assumption  is  not  appropriate,  then  a  more  general 
detection  approach  such  as  the  generalized  likelihood  ratio  test  or  the  multiple 
model  detection  algorithm  should  be  considered. 
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5.4  LOS  DETERMINATION  AND  TRACK  LOOP  COMPENSATION 
5.4.1  LOS  Determination 

In  the  tracking  architecture  of  Sec.  5.1,  the  LOS  determination  component  has 
two  functions:  (1)  using  the  target  location  estimate  and  other  measurements 
to  determine  the  target  LOS  state  vector  and  (2)  predicting  the  next-frame 
target  location  for  use  in  the  target  location  estimator.  As  part  of  the  target 
location  prediction  function,  the  LOS  determination  component  might  also 
provide  the  prediction  accuracy  for  use  in  gating  or  search  area  definition  (Sec. 
5.3).  LOS  state  vector  determination  and  location  prediction  estimation  are 
strongly  related  functions.  If  a  Kalman  filter  is  used  for  LOS  determination, 
then  both  of  these  functions  can  be  performed  in  the  filter  algorithm.38 

The  LOS  state  vector  is  commonly  defined  by  the  gimbal  positions  and 
velocities  in  azimuth  and  elevation.  Other  state  definitions  are  sometimes  used, 
but  this  definition  is  suitable  for  most  tracking  problems.  The  earliest  tracking 
systems  often  did  not  estimate  or  use  LOS  velocities.  In  these  systems,  the 
LOS  position  determined  by  the  target  location  estimator  was  forwarded  di¬ 
rectly  to  the  loop  compensator,  as  though  the  LOS  velocity  were  zero.  These 
early  systems  worked  well  for  static  pointing  or  for  tracking  slowly  moving 
targets.  To  maintain  a  stable  LOS  against  more  rapidly  moving  targets  and/ 
or  when  tracking  from  a  moving  sensor  platform,  however,  it  is  often  necessary 
to  include  the  LOS  velocity  in  the  state  vector.14 

Another  input  to  the  LOS  determination  component  is  the  breaklock  flag, 
which  is  set  by  the  breaklock  detector  when  the  target  location  estimate  is 
unreliable.  When  the  breaklock  flag  is  set,  the  LOS  determination  does  not 
utilize  the  target  location  estimate  to  compute  the  LOS  state  vector.  This  opens 
the  track  loop.  In  this  open-loop  condition,  the  tracker  is  said  to  be  operating 
in  the  coast  mode .  Coasting  continues  until  the  target  is  reacquired  and  the 
target  location  estimate  again  becomes  reliable.  Even  then,  however,  target 
location  prediction  may  not  become  sufficiently  reliable  for  several  frames, 
until  the  adaptation  process  in  the  target  location  estimation  has  settled  down. 
As  a  consequence,  if  the  target  location  estimation  algorithm  is  adaptive,  as 
discussed  in  Sec.  5.2,  then  a  transition  mode  between  the  coasting  and  tracking 
modes  may  be  advisable. 

In  the  coast  mode,  the  open-loop  pointing  commands  are  obtained  exclusively 
from  the  LOS  determination  component.  In  effect,  the  LOS  determination 
algorithm  continually  predicts  the  target’s  LOS,  which  is  then  transferred  to 
the  gimbal  control  to  carry  out  the  required  pointing  commands.  In  the  absence 
of  target  location  estimates,  the  error  between  the  true  target  LOS  and  the 
output  from  the  LOS  determination  component  will  continue  to  grow,  as  a 
result  of  both  inaccuracies  in  the  LOS  determination  gimbal  pointing  process 
and  unpredicted  target  motion.  Over  time,  this  error  grows  so  large  that  target 
reacquisition  becomes  impossible,  when,  for  example,  the  target  is  no  longer 
within  the  sensor’s  FOV.  At  this  point,  the  tracking  system  should  report  "loss 
of  track,”  which  signifies  that  intervention  by  the  operator  or  another  system 
is  required  if  tracking  is  to  continue.  An  important  performance  measure  for 
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Fig.  5.18  Mode  diagram  of  a  typical  tracking  system. 


a  tracking  system  is  the  length  of  time  it  can  be  expected  to  coast  before  loss 
of  track  is  declared.  Figure  5.18  shows  the  mode  diagram  for  a  typical  tracking 
system  including  the  modes  described  here. 

5.4.2  Track  Loop  Compensation 

The  track  loop  compensator  uses  the  state  vector  developed  in  the  LOS  deter¬ 
mination  component  to  generate  gimbal  pointing  commands.  The  compensator, 
which  is  a  sampled  data  transfer  function13  with  a  sampling  time  equal  to  the 
sensor’s  frame  time  Tf ,  is  designed  to  achieve  the  desired  closed-loop  error 
performance.  In  the  general  case,  the  entire  LOS  state  vector  is  utilized  in 
developing  the  gimbal  pointing  commands.  In  many  cases  of  practical  interest, 
however,  little  performance  degradation  results  if  the  LOS  vector  is  resolved 
into  its  orthogonal  components,  Az  and  El,  and  a  separate  loop  compensator 
is  constructed  for  each  component.  This  greatly  simplifies  the  design  (Fig.  5.19). 

The  performance  of  the  compensator  (and  hence,  the  tracker)  is  often  limited 
both  by  the  sensor’s  frame  rate  and  by  the  amount  of  latency  in  the  track  loops 
( loop  latency  is  also  called  transport  delay).  Increasing  the  sensor  frame  rate 
to  improve  compensator  performance  adds  substantially  to  the  computational 
requirements  because  the  processing  must  then  be  completed  in  a  shorter  time. 
Similarly,  reducing  loop  latency  can  also  increase  throughput  requirements. 
In  most  tracking  system  implementations,  loop  latency  tends  to  be  the  major 
influence  on  the  closed-loop  dynamics. 

Loop  latency  arises  from  two  major  sources:  the  sensor  and  the  processor. 
Figure  5.20  shows  a  loop  latency  time  line  typical  of  a  staring  sensor.  In  this 
figure,  the  frame  time  is  the  sum  of  the  photon  collection  time  of  the  sensor 
and  the  time  required  to  transfer  the  image  data  to  the  processor.  Loop  latency 
is  calculated  from  the  midpoint  of  the  photon  collection  period.  Once  the  image 
data  is  transferred  to  the  processor,  the  target  location  estimation,  LOS  de- 
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Fig.  5.19  Separable  loop  compensator  architecture. 
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Fig.  5.20  Typical  loop  latency  time  line. 


termination,  and  track  loop  compensation  functions  are  all  performed  before 
the  gimbal  pointing  command  is  initiated.  The  loop  latency  is  therefore  equal 
to  V2  the  photon  collection  time,  image  transfer  time,  and  all  of  the  processing 
time  before  the  gimbal  command.  The  processing  latency  part  can  be  reduced 
by  deferring  any  processing  that  is  not  directly  required  for  generating  the 
current  frame’s  gimbal  pointing  command  until  after  the  gimbal  command 
has  been  initiated.  This  includes  tasks  such  as  gate  sizing  and  target  location 
prediction.  Increasing  the  frame  rate  will  shorten  the  photon  collection  time 
and  hence  reduce  loop  latency. 

Compensators  are  designed  with  regard  to  two  key  parameters:  track  loop 
bandwidth  and  steady-state  tracking  error.  The  track  loop  bandwidth  governs 
how  quickly  the  tracking  loop  responds  to  changes  in  target  position.  Com¬ 
pensator  pole  and  zero  locations  and  loop  latency  are  adjusted  during  the  design 
process  to  achieve  the  desired  loop  bandwidth.  Steady-state  tracking  error  is 
independent  of  loop  latency  but  depends  on  open-loop  gain.  The  larger  the 
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open-loop  gain,  the  smaller  the  tracking  error.  If  zero  steady-state  tracking 
error  is  required,  an  open-loop  integrator  or  type  1  feedback  system  should  be 
considered.  Another  common  design  configuration  comprises  a  type  2  loop  with 
two  open-loop  integrations.  A  type  2  tracking  loop  tracks  a  target  moving  with 
constant  LOS  velocity,  with  no  steady-state  error.  A  trade-off  exists  between 
the  loop  type  and  the  loop  bandwidth. 


5.5  TRACK  LOOP  PERFORMANCE  PREDICTION 
5.5.1  Performance  Criteria  for  Tracking  Systems 

A  tracking  system  usually  constitutes  only  one  component  of  a  larger  entity 
such  as  a  weapon  system.  Hence,  the  criteria  used  to  measure  tracking  per¬ 
formance  must  reflect  the  larger  system.  For  example,  in  fire  control  appli¬ 
cations,  tracking  accuracy  is  a  critical  measure  of  performance.  There  are  two 
parameters  that  serve  to  quantify  tracking  performance  in  a  large  number  of 
applications.  These  are  tracking  accuracy  and  loss-of-lock  probability.  Other 
performance  criteria  include  the  rate  of  convergence  to  steady-state  tracking, 
robustness  against  countermeasures,  and  the  ability  to  deal  with  multiple 
targets. 

Tracking  accuracy  can  be  quantified  by  instantaneous  track  error  et(k).  The 
instantaneous  track  error  can  be  represented  by  the  algebraic  sum  of  three 
error  constituents: 

et(k)  =  eb(k)  +  ed(k)  +  ej{k)  ,  (5.36) 

where 

eb(k)  -  systematic  bias  term 

ed(k)  =  drift  error  representing  errors  that  grow  with  time 

ej(k)  =  random  pointing  (jitter)  error  resulting  from  noise;  white  noise 
is  commonly  assumed  for  analysis. 

The  bias  term  e&(&)  can  arise  from  mechanical,  servo,  and/or  gyro  errors. 
Offsets  in  the  target  location  estimation  algorithm(s)  can  also  lead  to  bias 
error.  Drift  error  may  result  from  adaptation  in  the  target  location  algorithms 
and/or  from  gyro  drift.  The  jitter  error  ej(k)  arises  from  noise  in  the  sensor 
data,  roundoff  errors  in  the  processor,31  and  sensor  platform  disturbances. 

Loss  of  lock,  quantified  by  the  loss-of-lock  probability  Pl ,  can  be  caused  by 
extreme  target/platform  motions  and/or  by  imagery  in  which  the  target’s  lo¬ 
cation  cannot  be  reliably  estimated.  Loss  of  lock  caused  by  target  motion 
usually  results  from  a  poorly  performing  LOS  determination  function  and/or 
the  gimbal  control  system.  The  specific  cause  can  be  found  by  the  hybrid 
analysis  method  (Sec.  5.5.3),  which  employs  characterizations  of  target  location 
estimator  performance.  (These  characterizations  were  described  in  Sec.  5.2.) 
The  hybrid  approach  enables  target  motion  parameters  and  servo  parameters 
(e.g.,  acceleration  and  processor  latency)  to  be  related  to  P/,. 

Analytically,  it  is  difficult  to  determine  the  conditions  for  loss  of  lock  re¬ 
sulting  from  an  unreliable  estimate  of  the  target’s  location.  The  primary  means 
of  determining  Pl  for  this  case  is  simulation  of  the  image  processing  algo- 
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rithm(s)  using  imagery  containing  the  particular  scene  factor  to  be  investi¬ 
gated.  Scene  factors  that  may  result  in  loss  of  lock  include: 

•  significant  target  signature  changes,  such  as  a  gun  blast 

•  target  obscuration  by  ground  clutter 

•  multiple  targets  in  a  crossing  maneuver 

•  thermal  merging  or  loss  of  contrast  between  parts  of  the  target  and  the 
background 

•  dead  or  erratically  behaving  detectors  or  sensor  readout  electronics. 

5.5.2  Analytical  Pointing  Accuracy  Prediction 

Performance  predictions  based  on  analytical  models  are  often  quite  useful  for 
design  trade-off  studies.  Because  many  tracking  algorithm  combinations  are 
possible,  it  is  helpful  to  carry  out  trade-off  studies  at  an  early  stage  in  the 
design  process  to  narrow  the  design  trade  space.  Analytical  performance  pre¬ 
diction  is  also  useful  after  a  design  has  been  completed  to  aid  in  the  evaluation 
of  system  test  results  and  as  a  validation  for  simulation  experiments. 

Analytical  prediction  is  difficult  for  any  system  as  complex  as  a  typical 
tracking  system.  Nevertheless,  methods  are  available  for  obtaining  answers 
to  certain  performance-related  questions.  Small-signal  analysis  is  one  such 
method.  For  this  technique,  it  is  assumed  that  all  signal  variations  are  small 
enough  that  nonlinear  input-output  processes  can  be  modeled,  to  sufficient 
accuracy,  by  linearizing  about  the  nominal  operating  point.  As  a  consequence, 
the  well-known  procedures  from  linear  systems  theory  can  be  applied. 

Small-signal  analysis  is  particularly  effective  for  predicting  the  pointing 
accuracy  of  a  tracking  system.  Pointing  accuracy  is  normally  specified  for 
steady-state  tracking  conditions,  i.e.,  after  the  tracking  system  has  locked  onto 
the  target  and  initial  transients  have  subsided.  In  the  steady-state  mode,  LOS 
corrections  are  ordinarily  small  enough  to  justify  the  small-signal  assumption. 

Figure  5.21  is  a  block  diagram  of  a  linearized  system  model  useful  in  pointing 
accuracy  analysis.  Note  that  the  target  location  estimation  component  has 


Target  and  Target  LOS 

Platform  Location  Determination 

Motions  Error  Error 


Fig.  5.21  Block  diagram  of  the  linearized  small-signal  model  used  for  pointing  prediction. 
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been  represented  by  a  dynamic  linear  component  with  additive  noise.  The 
dynamic  model  is  used  to  account  for  adaptation  associated  with  the  target 
location  estimation  algorithm.  Adaptation  is  modeled  by  the  discrete  time 
transfer  function  G\{z). 

The  LOS  determination  component  is  modeled  by  its  linearized  transfer 
function  G2U),  and  the  track  loop  compensator  and  the  gimbal  dynamics  are 
modeled  by  their  discrete  time  or  sampled  data  transfer  functions  Gz(z)  and 
Ga{z),  respectively.  If  the  LOS  determination  algorithms  contain  geometric 
transformations,  these  are  replaced  by  their  derivatives  evaluated  at  the  nom¬ 
inal  operating  point.  If  the  LOS  determination  component  employs  an  extended 
Kalman  filter,  it  is  replaced  by  its  linear  steady-state  form.  The  LOS  error 
signal  represents  the  effect  of  ancillary  measurement  errors  on  the  LOS  es¬ 
timate.  The  LOS  error  signal  can  also  contain  random  platform  disturbances, 
which  can  be  modeled  by  a  random  noise  source  and  periodic  signals. 

The  output  signal  yp  is  the  tracking  system  pointing  error.  Analytic  methods 
from  linear  feedback  analysis  can  be  used  to  determine  the  relationship  be¬ 
tween  ep  and  the  target  location  (TL)  and  LOS  errors.13 


G2G3G4  \ 

1  -  Gi  +  G2G3G4)eTL 


G3G4(1  -  Gi ) 

1  —  Gi  +  G2G3G4 


eLOS 
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Tracking  systems  are  sometimes  characterized  by  their  steady-state  or 
asymptotic  tracking  error,  which  is  typically  calculated  with  the  target  location 
error  and  LOS  error  signals  removed.  The  steady-state  error  is  a  measure  of 
the  tracking  loop’s  ability  to  point  the  gimbals.  For  a  stationary  target,  this 
steady  state  error  is 
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where  ess  is  the  steady-state  track  error  to  a  step  change  assuming  that  limGi 
=  0,  which  is  true  if  the  adaptation  converges.  1 

A  special  case  of  the  steady-state  tracking  error  is  defined  for  a  target  whose 
angular  velocity  is  constant  with  respect  to  the  sensor  platform.  Assuming 
again  that  the  adaptation  converges,  this  error  is  given  by 

Tf 
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where  ess  is  the  steady-state  track  error  to  a  target  with  constant  velocity  and 
Tf  is  the  frame  time  (period)  of  the  imaging  sensor. 

The  small-signal  assumption  was  invoked  to  permit  use  of  the  linear  model 
on  which  the  preceding  results  are  based.  If  it  is  necessary  to  characterize  the 
performance  of  the  tracking  system  for  large  variations  in  target  position,  the 
described  analytic  approach  usually  breaks  down.  Performance  predictions  for 
large  variations  generally  require  a  simulation  study. 
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5.5.3  Tracking  System  Performance  Prediction  through  Simulation 

Because  AVTSs  are  usually  implemented  as  nonlinear  feedback  systems,  it  is 
difficult  to  predict  tracking  performance  analytically,  except  in  special  cases 
where  small-signal  analysis  is  valid.  In  most  cases  of  practical  interest,  per¬ 
formance  predictions  are  obtained  from  Monte  Carlo  simulations  that  incor¬ 
porate  target  and  background  data  or  models,  the  applicable  tracking  and  LOS 
determination  algorithms,  and  a  nonlinear  model  for  the  gimbal  control  system 
and  sensor  platform.  Platform  disturbances  can  be  modeled  as  colored  noise 
with  discrete  harmonic  components  to  represent  periodic  disturbances  from 
sources  such  as  a  cryogenic  pump.  For  the  most  part,  Monte  Carlo  simulation 
experiments  do  not  provide  the  insight  needed  to  optimize  the  tracking  system 
design,  but  they  can  be  quite  useful  for  evaluating  its  performance  limits. 

Simulation  experiments  are  particularly  effective  in  predicting  the  point  at 
which  tracking  will  break  down.  As  long  as  the  target’s  angular  velocity  re¬ 
mains  constant  or  changes  slowly,  the  tracking  system  will  be  able  to  follow 
it  and  maintain  track.  But  if  the  target  undergoes  a  sudden,  large  acceleration 
(e.g.,  a  tactical  aircraft  switching  on  its  afterburners),  it  may  escape  from  the 
tracker’s  search  field,  resulting  in  loss  of  lock.  It  is  often  important  to  determine 
the  point,  falling  between  these  limiting  cases,  at  which  the  breaklock  occurs, 
especially  for  systems  tracking  maneuvering  targets. 

Tracking  systems  that  must  follow  maneuvering  or  accelerating  targets 
typically  exhibit  large,  nonlinear  signals  that  cannot  be  ignored  in  the  per¬ 
formance  analysis.  This  is  particularly  true  of  the  gimbal  component,  which 
often  exhibits  saturation  effects. 

A  complete  Monte  Carlo  simulation  for  a  tracking  system  is  computationally 
very  intensive,  and  therefore  costly.  The  primary  reason  for  this  stems  from 
the  need  to  simulate  the  nonlinear  control  components  and  the  image  pro¬ 
cessing  components  simultaneously.  The  extent  to  which  simulation  of  a  track¬ 
ing  system  design  can  realistically  be  carried  out  is  often  sharply  limited  by 
the  costs  involved.  Computational  expense  can  be  reduced  somewhat  by  split¬ 
ting  the  simulation  into  two  parts  comprising  (1)  image  processing  and  (2)  the 
closed-loop  control  system.  Although  closed-loop  effects  influence  image  pro¬ 
cessing  performance,  they  can  usually  be  modeled  separately  and  accounted 
for  without  resorting  to  a  complete  closed-loop  simulation.  For  example,  a  high 
angular  rate  between  the  target  and  the  sensor  LOS  can  smear  the  imagery 
produced  by  a  staring  FPA  sensor,  leading  to  diminished  tracking  performance. 
By  applying  the  appropriate  amount  of  smear  to  the  input  imagery,  this  closed- 
loop  effect  can  be  accounted  for  in  the  image  processing  part  of  the  simulation. 

The  closed-loop  control  system  simulation  models  the  effect  of  the  image 
processing  component  on  the  target  location  estimate  reported  to  the  LOS 
determination  component,  without  including  the  processing  algorithm  itself. 
This  model  is  coupled  with  an  accurate  simulation  of  the  tracking  loop’s  other 
components.  Figure  5.22  shows  the  structure  of  this  simulation.  Here,  the 
image  processing  part  has  been  represented  as  the  target  LOS  with  respect  to 
the  sensor’s  boresight,  with  an  additive  random  error.  The  analytical  error 
characterization  of  Sec.  5.2  can  be  used  for  the  error  signal. 

In  Fig.  5.22,  platform  vibrations  are  modeled  as  colored  noise  with  harmonics 
to  represent  periodic  components,  such  as  a  cryopump.  The  target  motion 
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Fig.  5.22  Hybrid  approach  to  tracking  performance  prediction. 


generator  models  the  target  dynamics  relative  to  the  sensor  platform.  Target 
dynamics  typically  studied  in  this  type  of  simulation  include 

•  Step  angular  position  change  that  models,  for  example,  the  shock  caused 
by  gunfire.  This  tests  the  system's  transient  response. 

•  Angular  velocity  with  respect  to  the  platform.  This  tests  how  well  the 
track  loop  will  follow  nonaccelerating  targets.  The  angular  rate  at 
which  the  track  loop  breaks  down  is  an  important  performance  speci¬ 
fication  for  fire  control  systems. 

•  The  Singer  model  for  maneuvering  targets.14’39 
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6.1  INTRODUCTION 

Signature  prediction  is  an  important  part  of  infrared  systems  analysis.  Re¬ 
alistic  assessments  of  IR  system  performance  depend  heavily  on  the  use  of 
signature  models.  These  models  should  include  and  faithfully  reproduce  the 
effects  of  the  most  important  radiative  signature  processes.  Because  IR  systems 
typically  utilize  contrast  between  a  target  and  its  background,  and  because 
natural  sources  of  target  infrared  radiation  are  frequently  important,  envi¬ 
ronmental  as  well  as  target  radiative  phenomena  must  be  included  in  predic¬ 
tive  analysis  tools.  The  combined  effects  of  environmental  variability,  target 
surface  and  thermal  properties,  and  interactions  between  structural  compo¬ 
nents  or  environmental  features  are  sufficiently  subtle  to  warrant  the  appli¬ 
cation  of  complex  numerical  models.  The  models  themselves  serve  to  enhance 
phenomenological  understanding  and  provide  a  very  cost  effective  means  to 
examine  a  wide  range  of  scenarios.  However,  this  is  effective  only  if  the  model 
has  been  validated  by  extensive  comparison  with  measured  data. 

Although  ultimately  there  are  no  substitutes  for  careful  analysis,  complex 
numerical  analysis  techniques  alone  may  be  unnecessarily  time  consuming, 
may  fail  to  provide  insight  into  the  operation  of  fundamental  processes,  or  may 
simply  be  unavailable  to  the  analyst.  In  this  event,  simple  analytic  techniques 
can  be  applied  that  may  provide  a  lower  level  of  fidelity  and  accuracy,  but  may 
be  adequate  for  a  specific  purpose. 

Simple  techniques  may  be  appropriate  for  those  occasions  when  it  is  useful 
to  estimate  the  infrared  intensities  of  objects  (military  targets,  in  particular) 
without  resorting  to  complex  and  time-consuming  computer  modeling  tech¬ 
niques.  Estimation  techniques  should  be  derived  from  first  principle  approx¬ 
imations  and  should  be  judged  by  their  ability  to  replicate  results  from  data 
or  from  more  complex  analytic  models.  The  analytic  techniques  presented  here 
are  all  designed  to  be  used  given  only  the  most  cursory  and  fundamental 
information  about  the  object  whose  signature  is  to  be  determined,  such  infor¬ 
mation  as  might  be  available  in  unclassified  and  generally  available  source 
publications. 

The  objective  of  this  chapter  is  to  provide  a  description  of  the  most  important 
phenomena  affecting  infrared  radiation,  especially  from  vehicles  that  are  po¬ 
tential  military  targets.  In  addition,  simplified  equations  are  provided  that 
allow  infrared  estimates  to  be  made. 

The  complexities  of  infrared  computations  are  such  that  many  large  com¬ 
puter  models  have  been  constructed  for  this  purpose.  We  shall  not  discuss  such 
models.  Simplified  calculations  may  serve  several  purposes,  including 

•  to  provide  zeroth-  or  first-order  infrared  estimates 

•  to  provide  checks  on  the  output  of  complex  models 

•  to  educate  the  analyst  on  the  basic  considerations  and  steps  used  by 
more  complex  models. 

The  last  purpose  should  not  be  overlooked.  The  analyst  will  operate  and  utilize 
a  complex  model  most  accurately  if  he  understands  the  phenomena  and  pro¬ 
cedures  on  which  it  is  based. 

To  achieve  reasonably  accurate  estimates  of  object  signatures  (observable 
infrared  radiation)  it  is  most  important  to  understand  the  complex  pheno¬ 
menology  that  determines  the  levels  of  radiation.  The  phenomenological  pro- 
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cesses  are  particularly  dependent  on  the  wavelength  of  the  radiation  to  be 
considered.  The  signature  of  an  object  is  also  dependent  on  the  aspect  presented 
to  an  observer. 

The  signature  phenomenology  of  many  objects  changes  markedly  as  the 
aspect  viewed  changes.  For  these  reasons,  it  is  not  possible  to  specify  a  simple, 
single,  rule  of  thumb  that  yields  an  accurate  radiant  intensity  for  all  wave¬ 
lengths  or  aspects.  For  example,  tail  views  of  aircraft  can  be  dominated  by 
either  the  plume  or  the  engine  hot  parts,  depending  on  whether  the  bandpass 
is  restricted  to  spectral  regions  containing  strong  plume  absorption  bands.  For 
views  of  the  nose  or  beam,  an  aircraft’s  radiation  may  be  governed  by  either 
the  emissive  or  reflective  characteristics  of  its  coating,  depending  on  the  band¬ 
pass.  In  the  mid- wave  infrared  (MWIR)  band,  typically  from  3  |j.m  (3300  cm"1) 
to  5  fim  (2000  cm"1),  exhaust  plumes,  solar  radiation,  and  thermal  emission 
all  play  significant  roles  in  determining  the  total  target  signature.  In  the  long¬ 
wave  infrared  (LWIR),  usually  8  |xm  (1250  cm"1)  to  12.5  |xm  (800  cm"1),  body 
thermal  emission  and  earthshine  reflections  usually  play  the  dominant  sig¬ 
nature  roles.  Small  changes  in  aspect  significantly  change  a  target’s  projected 
area  as  well  as  the  dominant  sources  of  radiation. 

As  a  starting  point,  one  should  bear  in  mind  that  wavelengths  shorter  than 
3.5  \xm  are  typically  dominated  by  hot  sources  of  radiation — the  sun,  engine 
hot  parts,  and  hot  exhausts.  Wavelengths  longer  than  5  jjim  are  typically 
dominated  by  cooler  surfaces,  plus  hot  parts  or  exhausts.  The  troposphere  is 
generally  opaque  in  spectral  regions  around  2.7,  4.3,  and  15  fxm. 

This  chapter  cannot  cover  all  classes  of  military  targets,  and  is  limited  to 
aircraft  (fixed  and  rotary  wing),  ground  vehicles,  and  ships.  We  refer  to  these 
as  objects  or  targets.  There  is  also  no  attempt  to  duplicate  the  detailed  treatment 
of  a  state-of-the-art  numerical  infrared  model.  As  stated  above,  the  intent  is 
to  supplement  such  models  with  a  more  simple  approach. 

We  can  make  an  initial  estimate  of  the  infrared  signature  of  a  target  of 
known  projected  area  by  assuming  that  it  is  a  blackbody  radiator  at  some 
equilibrium  temperature,  because  all  objects  radiate  in  the  infrared.  In  this 
case,  the  spectral  blackbody  radiance,  given  by  the  Planck  function,  is  inte¬ 
grated  over  wavelength  and  multiplied  by  the  target  area  projected  onto  a 
plane  orthogonal  to  the  observer’s  line  of  sight.  This  is  illustrated  in  Example  1. 

Example  1.  An  aircraft  is  shown  in  Fig.  6.1,  superimposed  on  a  geometric 
grid  that  can  be  used  to  estimate  the  target’s  projected  area.  The  target  is 
assumed  to  be  a  blackbody,  radiating  uniformly  in  all  directions.  For  a  typical 
tactical  aircraft,  the  beam  view  projected  area  is  about  30  m2.  If  the  target  is 
at  a  uniform  300  K,  the  Planck  blackbody  radiance  function,  expressed  in 
terms  of  wavelength, 

k  \5[exp (hc/\kT)  -  1] 

yields  a  radiance  of  0.003  W/m2  sr  cm"1  at  2220  cm"1  (4.5  |xm)  and  0.1  W/m2 
sr  cm"1  at  1000  cm"1  (10  fxm)  wavelength.  A  typical  mid-wavelength  infrared 
sensor  might  have  a  bandpass  from  4  to  5  |±m.  A  long- wavelength  sensor  might 
utilize  the  spectral  region  from  8  to  12  fxm.  Integrating  over  each  bandpass 
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Fig.  6.1  Beam  view  of  tactical  fighter  superimposed  on  grid  to  allow  estimate  of  its  area 
projected  in  the  direction  of  an  observer. 


gives  in-band  radiances  of  about  1.5  and  42  W/m2  sr,  for  the  mid-  and  long¬ 
wave  sensors.  The  approximate  target  source  radiant  intensity,  from  the  beam 
perspective,  is  then  about  45  and  1250  W/sr,  respectively.  These  radiant  in¬ 
tensity  values  might  be  representative  of  a  target  coated  with  a  very  low 
reflectance  paint,  seen  at  short  range,  and  flying  at  moderate  airspeed  at  low 
altitude  or  moving  faster  at  higher  altitude.D 

This  sample  estimate  was  based  on  unrealistic  assumptions  about  the  optical 
properties  and  thermal  conditions  of  the  target  surface.  It  also  neglected  the 
potentially  significant  target  radiation  resulting  from  exhausts,  reflected  earth, 
skyshine,  and  sunshine  and  the  transmissivity  of  the  atmosphere  between  the 
target  and  observer.  It  ignored  aspect-dependent  signature  components,  such 
as  variation  in  target  cross-sectional  area,  and  the  contribution  resulting  from 
engine  exhaust  ducts  and  plumes.  It  ignored  the  background  radiation  levels, 
which  determine  the  contrast  under  which  the  target  is  seen.  Each  of  these 
factors,  in  particular  circumstances,  can  significantly  impact  the  infrared  sig¬ 
nature  of  an  object.  In  the  sections  that  follow,  we  present  techniques  to  es¬ 
timate  each  of  these  effects. 

6.2  OBSERVABLE  INTENSITY  RELATIONS 

The  end  product  of  an  infrared  model,  suitable  for  input  to  a  sensor  study,  is 
usually  an  in-band  irradiance  as  incident  on  the  sensor  foreoptics.  For  some 
studies,  the  contrast  (target  minus  background)  irradiance  is  useful.  Because 
these  irradiances  contain  a  strong  factor  of  R~ 2 ,  where  R  is  a  range  to  the 
object,  the  object’s  radiant  intensity  is  often  computed  instead. 

These  radiometric  quantities  are  several  steps  removed  from  the  most  basic 
model  computation,  which  is  of  a  spectral  radiance  from  a  single  point  on  the 
object.  The  equations  in  this  section  illustrate  the  connection  between  them. 

Once  we  have  computed  the  spectral  radiance  L\(x)  of  each  visible  point  x 
on  the  object  (the  subject  of  the  rest  of  this  chapter),  we  can  proceed  to  integrate 
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Facet  Normal 


^  /if?* 


Observer 


Fig.  6.2  Vector  convention  for  object  and  observer  description. 


over  the  object’s  visible  projected  area  (see  Fig.  6.2).  Each  differential  area  dA 
is  multiplied  by  a  projection  factor  of  rr  6,  where  h  and  6  are  unit  vectors 
representing  the  local  surface  normal  and  the  direction  to  the  observer  (sensor). 
In  addition,  the  area  should  be  multiplied  by  an  obscuration  factor  of  0  or  1, 
depending  on  whether  the  point  is,  in  fact,  visible  to  the  sensor.  If  the  surface 
point  is  approximated  with  a  locally  flat  facet,  it  is  desirous  to  generalize  the 
obscuration  factor  to  a  fraction  visible,  between  0  and  1.  We  denote  a  small, 
visible  projected  area  as  oL4(x)*  for  the  surface  position  x. 

Given  the  preceding,  we  can  express  the  object’s  source  spectral  radiant 
intensity  as 


/srcQO  =  [  L(x,\)  <M(x)*  . 

•'object 


(6.1) 


The  term  source  (abbreviated  as  src)  is  used  to  denote  the  neglect  of  any  transfer 
effects  (absorption,  scattering,  emission)  between  the  object  and  sensor.  A 
second  useful  quantity  is  the  object’s  total  projected  area: 


To  convert  from  source  to  apparent  quantities,  we  include  foreground  trans¬ 
mittance  (Tfgd)  and  radiance  (Lfgd)  by 


-fapp(V)  —  -Isrc(^)Tfgd(^)  ■I'fgd(^)A*bject  • 


(6.3) 
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Note  in  Eq.  (6.3)  that  we  have  assumed  the  foreground  effects  to  be  approxi¬ 
mately  constant  across  the  object,  as  viewed  at  the  sensor.  A  contrast  radiant 
intensity,  against  a  locally  uniform  background,  is  then  computed  as 


■fcon(k)  —  IappOO  f^bkg(MA*bject  >  (6.4) 

where  Lbkg  is  the  background  radiance,  including  atmospheric  effects  all  the 
way  up  to  the  sensor.  Finally,  the  preceding  quantities  can  all  be  integrated 
spectrally,  with  an  optional  spectral  response  weighting  function  rsensor  for  the 
sensor: 


fcon(AX-) 


J. 


fcon(^)^ sensor(k)  d\ 


(6.5) 


The  radiance  of  any  point  can  have  contributions  from  emission,  transmission, 
and  reflection  (scattering).  For  our  present  purposes  we  distinguish  two  pri¬ 
mary  types,  namely,  (1)  opaque  surfaces  ("body”)  and  (2)  exhaust  gases  ("plume”). 
Opaque  surfaces  are  considered  to  emit  thermally,  and  to  reflect  their  envi¬ 
ronment;  any  transmission  is  neglected.  Plumes  are  considered  to  emit  ther¬ 
mally,  and  to  transmit  light;  scattering  of  light  is  neglected. 

Body  radiance  is  a  sum  of  different  components: 


Ltot  —  Lth  +  Lss  +  Z/es  +  Z'sky  +  Ljnter  +  Ltotpiume  > 


(6.6) 


where  Ltot  is  a  point’s  total  spectral  radiance  [the  same  as  L(x,\)k  Lth  is  the 
thermal  emission,  Lss  is  the  reflected  sunshine,  Les  is  either  reflected  earthshine 
or  cloudshine,  Lsky  is  reflected  skyshine  or  cloudshine,  Linter  is  the  inter-reflections 
of  the  target,  and  Ltotpiume  is  the  total  radiation,  emitted  and  transmitted, 
emanating  from  the  plume. 

In  the  case  of  a  ground  vehicle  or  ship,  the  interactions  term  may  include 
reflections  of  the  object  off  of  its  environment  as  well  as  the  reverse.  For  these 
cases,  such  reflections  can  be  an  important  part  of  the  object’s  total  signature. 
A  scene  may  also  contain  significant  signature  elements  resulting  from  the 
recent  passage  of  an  object  such  as  track  marks  or  a  ship’s  wake. 

The  spectral  radiance  from  a  plume  has  only  two  terms,  an  emission  term 
and  a  transmittance  term  (neglecting  the  scattering  term,  which  can  be  im¬ 
portant,  as  for  visible  contrails): 


Ltotpiume  “  Lplumeemis  +  TplumeLbehind  plume  > 


(6.7) 


where  Lplumeemis  is  the  plume’s  own  emission,  TpiUme  the  plume’s  transmittance, 
and  Lbehind  plume  the  radiance  of  whatever  is  behind  the  plume  from  the  ob¬ 
server’s  point  of  view  (the  target,  background,  etc.). 

Each  of  these  component  radiation  sources  is  discussed  in  turn.  Moreover, 
techniques  are  introduced  to  estimate  the  contribution  of  thermal  emission, 
environmental  sources  of  reflected  radiation,  and  plume  radiation. 
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6.3  GEOMETRY  DESCRIPTION 

To  perform  infrared  signature  calculations,  the  relative  positions  and  orien¬ 
tations  of  the  target,  the  observer,  and  the  environment  must  be  known.  The 
geometry  of  the  target  itself  must  also  be  known,  both  for  the  orientations  of 
its  various  surfaces  (relative  to  the  emission  sources  and  the  observer),  and 
for  obscurations  (hidden  surfaces).  These  are  discussed  in  the  following. 

6.3.1  Scene  Coordinates 

Assume  a  coordinate  system  called  the  basic  coordinate  system  (BCS)  centered 
at  the  target  (see  Fig.  6.3).  It  is  a  right-handed  Cartesian  system  with  the  z 
axis  pointed  up  along  the  local  vertical.  The  x  and  y  axes  are  in  the  local 
horizontal  plane.  Usually,  the  x  axis  points  in  the  direction  of  vehicle  heading 
(as  if  there  is  no  pitch  or  angle  of  attack).  The  sun  and  observer  are  defined 
in  spherical  coordinates  from  the  origin.  Assume  for  simplicity,  therefore,  that 
the  object  is  seen  at  long  range  and  all  surface-to-observer  directionals  are 


Z 


Observer  (reader)  Zenith  angle  =  80° 
Observer  (reader)  Azimuth  angle  =  25° 


Fig.  6.3  Diagram  of  the  basic  coordinate  system,  showing  the  axes,  angle  of  attack  (AO A), 
and  zenith  (0)  and  azimuth  (<j>)  angles  to  either  the  sun  or  observer. 
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parallel.  For  a  typical  target,  an  observer  range  of  350  m  is  sufficient  to  keep 
the  maximum  angular  error  within  5  deg. 

6.3.2  Target  Coordinates 

Another  useful  coordinate  system  is  the  target  coordinate  system  (TCS).  The 
TCS  is  a  right-handed  Cartesian  system  that  is  fixed  to  the  target  body,  so 
that  it  rolls  and/or  pitches  with  the  body.  The  recommended  convention  has 
the  ^  axis  "Vertical”  to  the  target,  the  x  axis  pointing  forward,  and  the  y  axis 
pointing  out  the  left,  or  port,  side.  These  axes  describe  a  right-handed  system 
with  azimuth  angles  measured  positively  counterclockwise  from  the  nose;  read¬ 
ers  should  not  confuse  this  system  with  the  common  pilot’s  usage  of  azimuths 
measured  clockwise,  implying  a  left-handed  system.  Because  the  TCS  is  by 
definition  fixed  to  the  target,  the  target  surface  coordinates  are  always  input 
in  this  system.  An  example  of  a  faceted  target  description  is  also  shown  su¬ 
perimposed  in  the  coordinate  system  in  Fig.  6.3;  this  is  known  as  a  wire-frame 
drawing.  Such  geometric  data  bases  are  often  generated  from  computer-aided 
design  (CAD)  systems  or  loft-line  drawings,  which  may  use  a  different  coor¬ 
dinate  system.  One  very  common  system  has  the  x  axis  pointing  out  the  rear 
of  the  vehicle,  so  that  the  x  values  increase  from  nose  to  tail.  In  this  system, 
the  x  values  denote  target  stations ,  the  y  values  denote  butt  lines  or  body  lines , 
and  the  z  values  denote  water  lines,  in  typical  design  parlance.  If  such  a  system 
is  used,  then  observer  and  sun  azimuth  angles  would  have  to  be  measured 
from  the  tail  of  the  vehicle. 

A  target  may  be  approximately  described  by  a  set  of  flat  facets,  which  are 
often  triangles  or  quadrilaterals.  We  use  this  technique  in  our  examples  as  a 
computational  aid  when  integrating  across  an  object.  Examples  of  simple  models 
of  a  ship  and  a  tank,  whose  polygonal  surfaces  can  be  constructed  of  triangular 
or  quadrilateral  facets,  are  shown  in  Figs.  6.4(a)  and  (b). 

The  visible  area  of  each  facet  projected  toward  the  observer  can  be  obtained, 
as  can  the  visible  fraction  of  a  facet’s  area.  The  first  result  is  the  term  A*, 
referred  to  in  Sec.  6.2,  and  is  needed  to  spatially  integrate  from  radiances  to 
radiant  intensities.  The  sunlit  area  of  each  facet  may  be  multiplied  by  the 
solar  irradiance  to  obtain  the  amount  of  sunlight  falling  on  that  facet. 

The  first  step  in  making  an  accurate  estimate  of  the  infrared  signature  of 
a  target  is  to  create  a  reasonably  faithful  rendering  of  the  target  shape.  Ex- 


Fig.  6.4  Simple  facetized  rendering  of  (a)  a  tank  and  (b)  aircraft  carrier. 
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Fig.  6.5  Plan  view  and  shaded  3-D  drawing  of  sample  tetrahedronally  shaped  object:  flying 
wedge. 


ample  2  provides  the  geometric  basis  for  the  target  signature  calculations  in 
forthcoming  sections. 

Example  2.  Figure  6.5  shows  plan  views  of  a  simple  geometric  shape  whose 
form  is  suggestive  of  a  modern  aircraft.  The  shape  is  that  of  a  tetrahedron 
whose  height  is  less  than  either  length  or  width,  and  whose  length  is  slightly 
greater  than  its  "span.”  The  dimensions  and  relative  scale  of  the  object  are 
similar  to  the  more  complex  tactical  aircraft  it  is  meant  to  represent.  The  value 
of  this  simple  shape  is  that  each  of  its  surfaces  can  be  treated  separately  and 
in  detail  to  calculate  its  infrared  signature.  In  this  way,  the  techniques  for 
calculating  each  signature  component  can  be  clearly  illustrated.  Although  four 
triangular  surfaces  are  far  too  few  to  adequately  describe  actual  targets,  many 
such  shapes  can  be  combined  to  create  complex  geometries.  Also,  the  com¬ 
plexity  of  detail  is  easily  incremented  to  incorporate  progressively  more  com¬ 
plex  signature  phenomenology.  We  have  christened  this  shape  as  the  F-118 
flying  wedge ,  and  remaining  calculations  are  based  on  viewing  its  component 
surfaces.  □ 

In  the  foregoing,  a  target-centered,  spherical  coordinate  system  was  intro¬ 
duced,  which  specified  the  direction  to  observers  and  environmental  sources 
of  radiation  like  the  sun,  earth,  moon,  or  sky.  A  rectilinear  coordinate  system 
is  used  to  define  vectors  that  characterize  the  orientation  of  each  body  surface. 
Azimuth  and  zenith  of  observer  and  radiation  sources  can  be  converted  to 
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vectors  in  this  coordinate  system  to  accomplish  the  radiation  calculations.  The 
radiation  apparent  to  an  observer  viewing  any  surface  depends  on  the  orien¬ 
tation  of  the  surface  normal  with  respect  to  the  observer’s  line  of  sight. 

The  simple  tetrahedron  target  has  one  face  lying  in  the  X-Y  plane,  with  its 
normal  in  the  negative  2  direction  (downward).  Another  face  lies  in  the  Y-Z 
plane  with  its  normal  directed  in  the  negative  x  direction  (rearward).  The 
figure  is  bilaterally  symmetrical,  with  equal  volume  lying  on  either  side  of 
the  X-Z  plane.  The  tetrahedron’s  dimensions  are  determined  by  its  height  (z 
dimension),  the  length  of  the  diagonal  edge  R  in  the  Y-Z  plane,  and  the  tet¬ 
rahedron’s  length  along  the  x  axis,  which  are  in  the  ratio  1:2:3,  respectively. 

The  projected  area  of  a  target  surface  to  an  observer  is  equal  to  the  product 
of  the  surface  area  and  the  cosine  of  the  angle  formed  by  the  surface  normal 
and  the  vector  to  the  observer.  In  the  three-dimensional  rectilinear  coordinate 
system,  this  is  equivalent  to  the  product  of  the  surface  area  with  the  dot  product 
of  the  two  vectors. 

For  the  relative  dimensions  previously  given,  the  area  of  each  surface  is 
determined  by  simple  geometry,  where  the  height  of  the  object  in  dimensionless 
units  is  1. 

Ventral  Surface  Area  A.  The  area  of  surface  A  is  equal  to  the  area  of  the 
triangle  abc: 

area  Aabc  =  A  a  =  ^(2  r)l  -  rl  (-  3\/3)  • 

Rear  Surface  Area  B.  The  area  of  surface  B  is  equal  to  the  area  of  the  tri¬ 
angle  bed. 

area  A  bed  =  Ab  =  ~(2  r)h  -  rh  (=  V3)  . 
z 

Port  and  Starboard  Dorsal  Surface  Areas  C  and  D .  The  area  of  surfaces  C 
(triangle  abd  with  area  Ac )  and  D  (triangle  acd  with  area  Ad)  can  be  found 
using  the  Pythagorean  theorem  and  the  shared  altitude  of  the  two  right  tri¬ 
angles,  abe  and  ade,  that  are  interior  to  the  triangular  surface  abd: 

Ac, Ad  =  ~(Rt)  > 

where  t  is  the  length  of  the  shared  altitude  of  right  triangles  abe  and  ade : 

t  =  [(rh)2  4-  ( Ih )2  +  (rl)2f/2/(r2  4-  h2)l/2  , 

Ac,  Ad  =  [(rh)2  +  (lh)2  +  (rl)2f/2/ 2 


The  normal  unit  vectors  of  each  of  the  four  surfaces  are  listed  or  derived  below: 


310  IR/EO  HANDBOOK 


•  Ventral  surface  normal  A:  A  =^-k 

•  Rear  surface  normal  B:  1 B  =  —i 

•  Port  and  starboard  dorsal  surface  normals  C  and  D. 

The  unit  normal  vector  for  surface  C  (C)  is  given  by  the  cross  product  of  vectors 
q  (along  edge  S)  and  r  (along  edge  L)  divided  by  its  absolute  value  (see,  for 
example,  Ref.  1  for  an  explanation  of  vector  operations): 

C  =  (q  x  r)/|q  x  r|  , 
where 

q  =  ~(li  -  rj)  and  r  =  -(li  -  hk)  , 

C  =  (rhi  +  Ihj  +  rlkmih)2  +  ( rl )2  +  (rh)2f/2  , 

C  =  (rhi  4-  Ihj  +  rlk)l2Ac  , 

C  =  (i  +  V3 j  +  3^)/Vl3  . 

Similarly,  the  unit  vector  normal  to  surface  D  (D)  is  found  to  be 

D  =  ( rhi  -  Ihj  +  rlk)/[(lh)2  +  (rl)2  +  (rhff2  , 

D  =  ( rhi  -  Ihj  +  rlk)/2AD  , 

D  =  (i  -  Vs]  +  Sk)lVlS  . 


Projected  Area  for  Observer  1 .  The  observer  location  is  defined  in  the  BCS, 
by  specifying  the  zenith  (0)  and  azimuth  (<(>)  angles  and  range  from  the  object. 
Zenith  and  azimuth  angles  can  be  used  to  define  a  unit  vector  pointing  to  a 
point  source  or  an  observer,  in  a  Cartesian  system  as  shown: 

6  =  cos<|)  sin0i  +  sincj)  sin0 j  +  cos0&  . 

Consider  an  observer,  abeam  and  slightly  aft  of  the  target,  viewing  it  from 
just  below,  as  in  Fig.  6.6(a).  The  projected  areas  of  surfaces  A,  B ,  and  C  are 
found  by  multiplying  the  dot  product  of  the  vector  to  the  observer  (0)  and  the 
surface  unit  normals,  A,  B,  and  C,  with  the  three  respective  surface  areas,  as 
shown  in  the  following.  When  the  dot  product  goes  negative  the  observer  is 
behind  the  surface,  and  its  projected  area  is  taken  as  zero. 

The  projected  area  of  the  ventral  surface  A  is  given  by 

Apa  =  Aa(0  •  A)  =  rl[0  •(-£)] 

=  -  rl  cos0  (=  -  3\/3  cos0)  . 

The  projected  area  of  the  aft  surface  (B)  is 
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(b) 


Fig.  6.6  (a)  Flying  wedge  viewed  from  slightly  below  and  aft  of  a  beam  and  (b)  nose  view 
of  flying  wedge. 


Apb  =  Ab(0  •  B )  =  rh[0  •(-£)]=  -  rh  sin0  cos<|> 

(=  -  V3  sin0  cos(|>)  . 

The  projected  area  of  the  port  dorsal  surface  (C)  is  obtained  from 

Apc  =  Ac(0  •  C)  =  Acirh  sin0  cos<\>  +  Ih  sin0  sincj) 

+  rl  cos0)/(2 Ac) 

V3 

=  — -(sin0  cosc()  +  V3  sin0  sincj) 
z 

+  3  cos0)  . 

We  now  select  the  observer  angles, 

0  =  96  deg  and  <j>  =  110  deg  . 

The  projected  area  of  each  face  (in  nondimensional  units)  is 
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ventral  surface:  Apa  —  0.54  , 
aft  surface:  App  =  0.59  , 

dorsal  surface:  Ape  =  0.84  . 

The  object’s  total  (dimensionless)  area  is  about  2  square  units.  For  a  tetra¬ 
hedron  5  m  in  height  each  square  unit  corresponds  to  25  m2  of  area.  The  total 
projected  area  is  therefore  about  50  m2.  If  the  object  is  at  a  temperature  of  300 
K,  then,  assuming  that  it  radiates  as  a  blackbody,  its  radiant  intensities  at 
mid-  and  long-IR  wavelengths  (as  in  Example  1)  are  75  and  2100  W/sr. 

Projected  Area  for  Observer  2.  An  observer  with  a  direct  view  of  the  wedge’s 
nose,  as  shown  in  Fig.  6.6(b),  sees  projected  areas  of  surfaces  C  ( Ape )  and  D 
{Apd).  Expressions  for  the  projected  area  in  the  observer’s  direction  are  found, 
as  in  the  previous  example,  from  the  surface  unit  normals  (C,  D),  areas  (Aq, 
Ad),  and  the  observer  vector  O.  In  this  case,  0  =  90  deg  and  <f>  =  0  deg,  so,  O 
=  2,  and  therefore; 


Apc  =  Ac(0  ■  C)  =  Acii  •  C)  =  Ac[^j  =  y  . 

We  thus  have 

Ape  =  V3/2  , 

Apd  ~  V3/2  , 

total  area  =  APc  +  Apd  =  V3  . 

For  the  wedge  in  the  previous  example  the  projected  area  is  43.5  m2.  The  mid- 
and  long-wavelength  radiant  intensities  are  65  and  1830  W/sr. 

The  results  for  both  observers  are  summarized  in  Tables  6.1  and  6.2,  which 
list  the  projected  area  of  each  visible  surface  for  each  viewer  and  the  surface 
blackbody  radiant  intensities  at  our  exemplary  MWIR  and  LWIR  bandpasses. 

The  surface  normal  vectors,  and  the  projected  area  values,  derived  for  the 
nose  and  beam  observers  are  used  in  radiation  calculations  in  subsequent 
sections. 


Table  6.1  Projected  Area  by  Viewer  in  Nondimensional  and  Dimensionalized  Units 
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Table  6.2  Surface  Blackbody  Radiant  Intensity  (in  watts  per  steradian) 
for  MWIR  and  LWIR  Bandpass 


Radiant  Intensity  (W/sr) 

La 

Lb 

Lc 

Ld 

Total 

MWIR  Bandpass 

Aft  ventral  beam  view 

20.3 

— 

mm 

Nose  view 

— 

32.7 

iii 

LWIR  Bandpass 

Aft  ventral  beam  view 

567 

622 

882 

— 

2071 

Nose  view 

— 

— 

916 

916 

1832 

6.4  SIMPLIFIED  RADIATION  ENVIRONMENT  MODEL 

Because  reflections  of  an  object’s  environment  can  be  important,  it  is  necessary 
to  have  a  model  of  that  environment.  As  with  the  object  itself,  the  environment 
requires  a  geometric  model  and  a  radiance  model.  The  basic  radiance  formulas 
to  use  are  the  same  as  for  the  object  surfaces,  as  described  in  Secs.  6.5  and 
6.7.  The  geometric  model  must  depend  on  the  scenario. 

The  earth,  sky,  and  clouds  each  provide  both  thermal  emission  and  (in  the 
daytime)  solar  reflections.  Estimates  of  atmospheric  emission  and  scattering 
are  quite  challenging.  The  analyst  is  urged  to  consult  elsewhere  in  this  hand¬ 
book,  and  also  to  acquire  the  readily  available  computer  model2  MODTRAN. 

Airborne  objects  can  usually  be  considered  to  have  uniform  hemispheres  or 
infinite  planes  above  and  below  them,  representing  earth,  sky,  or  clouds.  Spa¬ 
tial  variations  along  the  earth,  or  across  fields  of  broken  clouds,  are  a  second- 
order  effect  for  reflection;  they  should  be  accounted  for  "on  average,”  when 
choosing  values  of  temperature  and  reflectance/emittance  for  the  hemispheres. 
The  sun  appears  as  a  disk  subtending  about  one-half  of  a  degree  of  angle.  It 
is  nearly  always  sufficient  to  represent  it  as  a  point  source,  although  the  disk 
model  is  just  about  as  easy  to  use. 

Objects  that  are  at,  or  near,  ground  level  often  have  a  full  3-D  environment, 
with  elements  such  as  walls,  trees,  or  hills.  The  analyst  must  decide  how  much 
detail  to  include,  and  what  geometric  description  to  use.  Both  the  element’s 
radiance  and  its  angle,  subtended  from  the  object,  should  be  considered.  Note 
that  angle  is  more  important  than  size — a  mountain  in  the  far  distance  is  a 
small  irradiance  source  compared  with  a  close-range  boulder.  Also,  if  the  ra¬ 
diance  of  an  environmental  element  is  close  to  that  of  surrounding  elements, 
they  should  likely  be  combined. 

There  are  many  instances  when  the  object  under  study  reflects  an  appre¬ 
ciable  amount  off  of  its  environment;  this  usually  occurs  when  they  are  phys¬ 
ically  close.  Examples  of  this  effect  are  ship  reflections  in  the  water,  or  car 
reflections  off  of  a  road.  In  such  cases,  the  object  and  its  environment  cannot 
be  clearly  separated  in  the  calculation.  A  good  approach  to  this  effect  is  to 
include  a  local  portion  of  the  environment  as  part  of  the  object  calculations. 

A  number  of  environmental  parameters  must  be  collected  before  its  radi¬ 
ances  can  be  computed,  for  subsequent  reflection  off  of  the  object.  These  pa¬ 
rameters  include  temperatures,  emittances,  diffuse  and  specular  reflectances, 


314  IR/EO  HANDBOOK 


the  solar  irradiance,  and  the  atmospheric  transmittance/radiance  between  en¬ 
vironment  and  object.  Material  on  most  of  these  may  be  found  elsewhere  in 
this  handbook. 

Temperatures,  of  course,  are  dynamic,  and  can  be  hard  to  estimate.  Healthy 
foliage  tends  to  stay  within  a  few  degrees  (up  to  10)  of  air  temperature  because 
of  evaporation.3  Branches  and  soil  can  easily  heat  up  10°C  or  more  above  the 
air  in  sunny  conditions.  Bodies  of  water  are  thermally  complex,  but  large  ones 
exhibit  surface  temperatures  that  are  nearly  independent  of  the  diurnal  cycle 
because  of  their  size  and  consequent  thermal  inertia.  The  date,  locale,  and 
recent  weather  history  of  the  water  can  often  provide  an  analyst  with  clues 
for  a  common-sense  estimate. 

Clouds  are  also  complex.  An  estimate  of  their  temperature  is  the  ambient 
air  temperature  at  the  cloud  altitude  (taken  from  data,  or  from  a  standard 
model  atmosphere  of  the  sort  mentioned  elsewhere  in  this  manual).  This  is 
more  accurate  for  stratiform  clouds  than  for  cumuliform  ones,  which  exhibit 
large  amounts  of  vertical  convection. 

Given  the  radiance  of  an  environmental  element  reaching  the  object,  we 
need  to  know  that  element’s  total  irradiance  on  the  object’s  surfaces.  For  a 
point  source  (the  sun)  one  needs  merely  to  project  the  source’s  intrinsic  irra¬ 
diance  (normal  to  its  direction)  onto  the  object  surface,  with  its  unit  normal 
vector  N: 

■^surface  =  ^sol(A^  S)  , 

where  S  is  a  unit  vector  toward  the  sun.  For  a  Lambertian  infinite-plane  source 
(earth,  sky)  with  unit  vector  normal  to  the  plane  NSVc  ( +  k  for  the  earth,  —  k 
for  the  sky)  we  find  that 


TT 


•^surface  —  ^  -^source 


(1  -  (iVsrc  •  m  • 


These  values  would  be  reduced  by  transmission  losses  resulting  from  atmo¬ 
spheric  scattering  and  absorption  occurring  between  the  source  and  surface. 
Clearly,  the  shorter  the  column  length  or  the  lower  the  density  of  intervening 
atmosphere,  the  smaller  the  transmission  losses.  Atmospheric  emission  tends 
to  offset  the  losses.  Calculations  using  the  unattenuated  irradiance  usually 
yield  upper  limits  to  surface  illumination  levels. 

Example  3.  Solar  Irradiance  on  Object  Surfaces.  The  magnitude  of  the  solar 
irradiance  on  the  surface  of  the  flying  wedge  can  be  obtained  for  a  specific 
time  of  day  and  target  orientation.  It  is  given  by 

■^surface  ~  E}so\{M  S)  , 

where  N  is  the  unit  surface  normal  vector  and  S  is  the  unit  vector  toward  the 
sun.  As  before,  negative  dot  products  indicate  the  sun  is  behind  the  surface. 
The  position  of  the  sun  selected  for  this  sample  calculation  anticipates  reflected 
radiation  calculations  to  be  performed  in  succeeding  sections  and  S  is  taken 
to  be 
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Sx  =  [(rh)2  -  2Ac]/2Ac  (=  -11/13)  , 

Sy  =  lrh2/2A2c  (=  2V3/13)  , 

S2  =  lhr2!2Ac  (=  6/13)  , 

S  =  -(lit  -  2V3 7  -  6*)/13  . 

This  choice,  corresponding  to  zenith  and  elevation  angles  of  62.5  and  162.5 
deg,  respectively,  anticipates  an  example  in  Sec.  6.7  that  demonstrates  the 
relative  importance  of  solar  illumination  to  an  object’s  IR  signature,  while 
maintaining  calculational  simplicity.  The  sun  is  positioned  to  provide  a  sun 
glint  toward  an  observer  viewing  the  object  nose.  Because  the  solar  irradiance 
varies  with  the  orientation  of  the  illuminated  surface,  the  magnitude  and 
importance  of  solar  radiation  reflected  from  a  surface  will  also  vary. 

The  target’s  coordinate  system  is  taken  to  be  superimposed  on  the  inertial 
frame,  its  nose  at  the  origin,  and  no  pitch,  roll,  or  yaw.  In  this  case,  only  the 
rear  and  dorsal  surfaces  are  illuminated  by  the  sun.  The  unit  normal  vectors 
for  these  surfaces  are 

B  —  -i  , 

C  —  (rhi  +  Ihj  4-  rlk)/2Ac 
=  (i  +  V3 j  +  3A0/V13  , 

D  =  (rhi  -  Ihj  +  rlk)!2Ac 
=  (i  -  VSj  +  3A0/V13  . 

Taking  the  dot  product  of  source  direction  and  surface  normal: 

S  ■  B  =  -[(rh)2  -  2A2c]I2A2c  (=  11/13)  , 

S  ■  C  =  rhl2Ac  (=  1/VI3)  , 

S  ■  D  =  [Ac  -  (lh)2]rh/2Ac  (=  1/13V13)  . 

For  the  flying  wedge,  the  solar  irradiance  on  each  surface  is  then 
Eb  =  £soi(ll/13)  , 

EC  =  £soi(l/Vl3)  , 

Ed  =  £Soi(l/13vT3)  . 

We  can  approximate  the  radiance  of  the  sun  by  taking  it  to  be  roughly  equiv¬ 
alent  to  a  blackbody  at  5800  K.  In  this  case,  integrating  over  the  mid-wavelength 
infrared  band  of  4  to  5  pm,  Z£soi  is  about  6  W/m2.  Integrating  from  8  to  12  pm, 
Eso\  is  estimated  to  be  about  1  W/m2.  □ 
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Example  4.  Earth  and  Sky  Irradiance  on  Object  Surfaces.  The  earth  and 
sky  (and  over-  or  underlying  cloud  layers)  are  extended  sources  of  radiation 
that  may  either  form  a  background  or  be  reflected  off  of  object  surfaces.  If 
these  extended  sources  are  simulated  by  infinite  planes  at  constant  temper-, 
atures  over  or  under  the  object,  the  source  directions  are  always  oriented  in 
either  the  positive  or  negative  2  direction.  The  expression  for  irradiance  of  an 
object  surface  resulting  from  an  infinite  plane  source  is 

A  A 

•Ssurf  =  'nT'source  [1  -  (iVsrc  *  iVsurf)]/2  . 

This  expression  indicates  that  sky  radiation  illuminates  the  dorsal  and  rear 
surfaces  of  our  sample  object.  Earthshine  provides  illumination  to  its  ventral 
and  rear  surfaces. 

For  the  flying  wedge,  dorsal  surface  irradiance  resulting  from  skyshine  and 
earthshine  is  found  by  knowledge  of  the  source  directions, 

Nsrc  ~  ~k  for  skyshine  and  iVsrc  =  k  for  earthshine  , 
and  surface  normals, 

N surf  =  0  or  D  . 

The  irradiance  on  surfaces  C  and  D  resulting  from  sky  and  earthshine  is  then 
Ec,d  =  TrLsky[l  -  (~k  •  C,Z»]/2 

+  TrLearthtl  ”  (k  •  C,  D)]l 2  , 

Ec,D  =  7TLsky(l  +  rl/2Ac)/2 

+  ^earthd  “  rl/2Ac)/2  , 

Ec,D  —  Tr-kskyd  +  3/Vl3)/2 

+  uLearthd  "  3/Vl3)/2  . 

A  a  A 

Similarly,  ventral  surface  [A^surf(  =  A  =  -  k) ]  irradiance  resulting  from  earth- 
shine  is  given  by 


Ea  ' —  TT-t'earthd  ’  kj\!2  'n'i'earth  • 


Irradiance  on  the  aft  surface  of  the  flying  wedge  results  from  contributions 
from  both  earth  and  skyshine  and  is  given  by 

N surf  =  B  =  —  i  , 

Eb  =  TT {Z/earth [  1  “  (k  *  ~  i) ]  +Z/Sky[l  ~  (~k  •  ~  l)]}!2  , 

Eb  —  'TrC^earth  +  Lsky)/2  . 
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Earthshine  can  be  first  approximated  by  assuming  that  the  earth  radiates  as 
a  blackbody  with  an  emissivity  appropriate  to  the  type  of  terrain  below  the 
object.  Assuming  a  temperature  of  305  K  and  an  emissivity  of  0.9,  earthshine 
radiance  is  about  2  W/sr  m2  at  MWIR  wavelengths  and  about  40  W/sr  m2  at 
LWIR  wavelengths. 

The  radiance  from  a  clear  sky  is  more  difficult  to  estimate  because  one  must 
solve  an  equation  of  radiative  transfer  through  a  nonhomogeneous  scattering 
medium.  From  the  earth’s  surface,  the  clear  sky  appears  cold  when  the  optical 
path  is  near  the  local  zenith,  and  warmer  when  viewing  the  horizon.  If  ah 
object  is  located  beneath  an  optically  thick  cloud  deck,  however,  illumination 
of  the  upper  surfaces  can  be  treated  in  a  manner  similar  to  the  earthshine. 
For  example,  a  low  hanging  cloud  at  285  K  would  produce  a  sky  radiance  of 
about  1  and  30  W/sr  m2  in  the  MWIR  and  LWIR,  respectively.  Clear  sky 
radiances  would  be  smaller.  Table  6.3  shows  the  unattenuated  irradiance  on 
each  surface  of  the  flying  wedge  from  solar  radiation  and  by  earth  and  sky  shine. 

These  values  are  reduced  significantly  by  atmospheric  attenuation.  With 
the  sun  at  the  62.5-deg  zenith  angle,  and  an  object  at  1-km  altitude,  the  solar 
irradiance  is  diminished  by  about  75%  in  the  MWIR  and  by  about  50%  at 
LWIR  wavelengths.  Even  at  low  altitudes,  atmospheric  attenuation  of  earth- 
shine  can  be  significant.  For  an  object  at  1  km,  the  average  attenuation,  es¬ 
timated  by  considering  a  pathlength  of  45-deg  nadir  is  about  one-half  at  MWIR 
wavelengths  and  about  one-third  in  the  LWIR.  If  the  cloud  deck  lies  1  km 
above  the  object,  atmospheric  attenuation  reduces  its  irradiance  by  about  half 
at  MWIR  wavelengths  and  by  about  one-fifth  in  the  LWIR. 

Table  6.4  shows  the  values  of  the  surface  irradiance  for  the  flying  wedge 
accounting  for  atmospheric  attenuation  of  the  incident  environmental  radiation. 


Table  6.3  Estimates  for  the  Unattenuated  MWIR  and  LWIR  Irradiance  of  Each 
Surface  of  the  Flying  Wedge  Resulting  from  Illumination  by  Solar  Radiation  and 

Earth-  and  Skyshine 


MWIR  Irradiance 

Solar 

Earthshine 

Skyshine 

Surface  Irradiance  (W/m2) 

Es oi  =  6  W/m2 

dearth  =  2  W/m2  sr 

Lsky  =  1  W/m2  sr 

Ea 

0 

6 

0 

Eb 

5 

3 

2 

Ec 

2 

0.5 

3 

Ed 

0.1 

0.5 

3 

LWIR  Irradiance 

Solar 

Earthshine 

Skyshine 

Surface  Irradiance  (W/m2) 

Ea „i  =  1  W/m2 

dearth  =  40  W/m2  sr 

Lsky  =  30  W/m2  sr 

Ea 

125 

0 

Eb 

65 

45 

Ec 

0.3 

10 

85 

Ed 

0.02 

10 

85 
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Table  6.4  Estimates  for  the  Attenuated  MWIR  and  LWIR  Irradiance  of  Each  Surface 
of  the  Flying  Wedge  Resulting  from  Illumination  by  Solar  Radiation  and  Earth-  and 
Skyshine,  with  Atmospheric  Attenuation 


MWIR  Irradiance 

Surface  Irradiance 

Solar* 

Earthshine 

Skyshine 

(W/m2) 

£aoi  =  1.5  W/m2 

Learth  =  1.0  W/m2  sr 

Ls ky  =  0.5  W/m2  sr 

Ea 

0 

3.00 

0 

Eb 

1.30 

1.50 

1.00 

Ec 

0.50 

0.25 

1.50 

Ed 

0.03 

0.25 

1.50 

LWIR  Irradiance 

Surface  Irradiance 

Solar* 

Earthshine 

Skyshine 

(W/m2) 

£aoi  =  0.5  W/m2 

Learth=  27.0  W/m2  sr 

£sky  =  24.0  W/m2  sr 

Ea 

0 

84 

0 

Eb 

0.4 

44 

36 

Ec 

0.15 

7 

68 

Ed 

0.01 

7 

68 

*Sun  at  zenith  angle  of  62.5  deg  and  azimuth  angle  at  162.5  deg.  □ 


The  attenuated  values  are  used  in  calculations  performed  in  subsequent 
sections.  With  the  radiation  environment  characterized,  the  next  step  is  to 
present  analytic  tools  to  define  the  interaction  of  an  object  surface  with  its 
environment. 

6.5  SIMPLIFIED  BRDF/EMISSIVITY  MODEL 

The  bidirectional  reflectance  distribution  function  (BRDF)  is  an  excellent  tool 
for  reflectance  model  development,  both  because  of  its  generality  and  because 
of  its  definition  as  the  ratio  of  two  convenient  radiometric  quantities.  The 
BRDF  is  defined  as 


G?Z/r(0r,<f)r;X.) 


(6.8) 


Thus,  the  BRDF  is  the  ratio  of  reflected  radiance  ( dLr )  to  the  incident  irra¬ 
diance  ( dEi ).  The  primary  purpose  of  this  section  is  to  provide  an  analytic 
BRDF  model  that  is  simple  enough  for  our  purposes  and  that  contains  the 
most  important  reflection  phenomena.  It  is  important  to  note  the  need  for  a 
concurrent  emissivity  model  that  conserves  energy  with  the  BRDF  and  that 
obeys  Kirchhoff  s  law.  We  neglect  surface  transmittance  in  the  current  model. 

Spectral  reflectance  variations  are  of  major  practical  importance,  but  usually 
occur  over  relatively  broad  wavelengths  compared  with  other  infrared  phe¬ 
nomena,  especially  atmospheric  transmission.  Because  the  modeling  approach 
used  in  this  section  can  easily  be  made  spectral,  we  consider  the  reflectance 
to  be  constant  over  local  spectral  regions  and  drop  all  spectral  subscripts  for 
convenience. 
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Rough  Surface 


Fig.  6.7  Effect  of  surface  roughness  on  specular  lobe  widths. 


Many  authors  have  pointed  out  the  phenomenon  of  quasispecular  reflection, 
in  which  light  incident  from  a  single  direction  is  reflected  over  a  spread  of 
directions  near  the  classical  Snell’s  law — incidence  angle  equals  reflected  an¬ 
gle — direction.4  These  specular  reflections  typically  form  a  lobe  of  finite  width, 
with  peak  reflectance  in  the  Snell’s  law  direction.  Real  surface  materials  ex¬ 
hibit  lobes  of  greatly  different  widths,  depending  on  surface  roughness  (see 
Fig.  6.7).  Lobe  widths  may  range  from  a  fraction  of  a  degree  to  tens  of  degrees. 
For  the  present  model,  we  idealize  to  lobes  that  have  constant  BRDF  within 
an  angular  region  and  are  0  elsewhere,  to  give  a  simple  representation  that 
captures  the  essence  of  specularity.  We  denote  the  lobe’s  full-width  angle  as  e. 

The  quasidiffuse  component  of  reflection  is  sometimes  used  to  represent 
surface  reflections  from  microfacets  whose  normals  are  far  from  the  bulk  sur¬ 
face  normal,5  and  sometimes  to  represent  volume  reflections  of  light  that  mul¬ 
tiply  scatters  inside  the  surface.6  Whatever  the  physical  model,  the  analytical 
model  is  certainly  a  useful  one.  Models  that  explore  diffuse  phenomena  provide 
useful  angular  reflectance  functions,  but  the  variations  with  angle  are  usually 
mild.  We  thus  take  a  common  course  herein,  and  approximate  the  diffuse 
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component  with  a  constant  Lambertian  BRDF.  Other  reflectance  character¬ 
istics,  which  we  do  not  consider,  include  off-specular  peaks,  polarization,  and 
grazing-angle  shadowing. 

The  ideal  limit  of  a  pure  Lambertian  BRDF  was  described  by  Nicodemus 
et  al.7  We  merely  combine  this  limit  with  an  idealized  specular  lobe  to  allow 
a  variable-specular  surface.  The  extension  to  spectral  variations  is  trivial,  if 
required.  Our  BRDF  model  is,  thus, 

=  — P  cf(X)  +  ps(X)g(iVsrc>Nsurf>0)  ,  (6.9) 

IT  , 

where  the  function  g  has  a  value  of  I/O  sin2(e/2)]  whenever  0  is  within  an 
angle  of  e/2  of  the  ideal  glint  direction  and  g  is  0  elsewhere.  Note  the  approx¬ 
imation  that  the  glint  lobe  is  always  entirely  above  the  surface  plane. 

The  analysis  is  not  complete  until  the  emittance  has  also  been  modeled.  If 
the  materiars  transmittance  is  taken  as  0,  then  conservation  of  energy  requires 
that  all  incident  light  be  either  reflected  or  absorbed.  The  total  reflected  light 
is  computed  by  the  integral  of  the  BRDF  over  all  reflection  solid  angles.  The 
light  absorbed  from  an  incident  direction,  from  Kirchhoff  s  law,  must  be  equal 
to  the  emittance  in  that  direction.  We  can  thus  write 

Jff(0i,<t>i;0r,<l>r;V  cos(6r)  sin(0r)  der  d<j)r  +  e(0,,<|>i;X)  =  1  .  (6.10) 

Substituting  our  simplified  BRDF  model,  Eq.  (6.9),  we  easily  obtain 

PdM  +  P  sM  +  e(0;,<|>;;\)  =  1  .  (6.11) 

The  reflectance  model  of  Eq.  (6.9)  thus  requires  that  the  emittance  be  constant 
(Lambertian)  with  angle,  or 

e(X)  =  1  —  pd(X)  ~  ps(X)  . 

This  simple  expression  significantly  mitigates  the  complexity  in  estimating  ra¬ 
diation  signatures.  It  retains  diffuse,  specular,  and  emittance  terms;  however, 
the  magnitude  of  any  two  can  be  varied  and  energy  will  be  conserved.  For  the 
example  calculations  we  have  used,  e  =  0.85,  p<*  =  0.05,  and  ps  =  0.10. 

6.6  BODY  TEMPERATURES 

In  spectral  regions  beyond  4  fim  having  fairly  high  transmittance,  the  emission 
from  the  object  surface  is  usually  the  largest  contributor  to  the  target  source 
signature.  These  emissions  are  typically  nongraybody  radiation  emitted  from 
a  non-Lambertian  surface  at  a  temperature  T. 

Thermal  calculations  for  an  object  should  account  for  heat  transfer  via  con¬ 
duction,  convection,  and  radiation  as  well  as  evaporation  and  condensation. 
This  topic  deserves  a  volume  to  itself;  for  present  purposes  we  discuss  approx¬ 
imations  for  different  classes  of  objects. 

Fixed-wing  aircraft  can  be  the  simplest  of  vehicles  to  model  thermally  to  a 
first  approximation.  They  are  of  necessity  built  with  a  thin  skin,  which  equi- 
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librates  quickly.  The  plane’s  motion  causes  convection  to  dominate  other  heat 
transfer  mechanisms,  and  most  of  the  outer  airframe  is  close  to  the  effective 
temperature  of  the  air’s  boundary  layer,  the  recovery  temperature  Tr : 

Tr  =  ramb^l  +  ,  (6.12) 

where  Tamb  is  the  ambient  air  temperature  (on  an  absolute  scale,  such  as 
kelvin),  y  is  the  air  specific  heat  ratio  (close  to  1.4  unless  greatly  heated),  r  is 
a  recovery  factor,  and  M  is  the  vehicle  Mach  number.  The  recovery  factor 
accounts  for  the  fact  that  the  effective  boundary  layer  temperature  is  less  than 
the  air  total  temperature  (also  called  stagnation  temperature)  Tt.  Values  of  Tt 
are  achieved  only  when  all  of  the  kinetic  energy  of  the  air’s  speed  is  converted 
into  thermal  energy  within  the  boundary  layer.  When  some  of  that  energy 
dissipates  to  the  airstream,  the  boundary  layer  achieves  only  the  cooler  value 
of  Tr.  Experience  shows  that,  at  moderate  subsonic  Mach  numbers,  a  recovery 
factor  of  0.85  is  a  good  estimate;  at  slower  speeds,  the  recovery  factor  should 
approach  unity.  Places  where  the  air  impinges  perpendicular  to  the  airframe 
(j stagnation  points)  will  have  a  boundary  layer  at  Tt.  For  an  aircraft  in  subsonic 
cruise,  Tr  is  often  about  20°C  above  Tamb-  Stagnation  points  are  generally 
small,  and  are  only  slightly  hotter,  and  so  can  be  neglected  to  a  first 
approximation. 

Radiative  cooling  is  partially  offset  by  radiative  absorption  of  earth  and  sky 
emissions,  until  it  becomes  large  when  the  aircraft  travels  supersonically. 
When  a  turbine  engine  afterburner  is  on,  however,  the  exhaust  emissions 
typically  dwarf  those  of  the  airframe,  except  for  near-nose  viewing.  Radiative 
terms  are  discussed  later  in  the  section. 

Turbine  engine  nozzles  are,  of  course,  important  emitters.  Although  nozzles 
are  thermally  complex,  a  reasonable  upper  bound  temperature  (which  is  often 
close  to  reality)  can  be  gained  from  the  recovery  temperature  of  the  exhaust 
gases  in  contact  with  it.  For  turbofan  engines,  one  must  consider  whether  it 
is  the  hot  core  flow  (from  the  turbine  exhaust)  or  the  warm  fan  flow  that  contacts 
the  nozzle  walls.  If  the  turbine  exit  is  directly  visible,  the  exhaust  total  tem¬ 
perature  is  a  good  estimate  for  it. 

It  is  extremely  difficult  to  estimate  exhaust  gas  temperatures  with  any 
accuracy  without  a  complex  model  of  the  engine  thermal  cycle.  Such  models 
are  routinely  constructed  by  engine  manufacturers,  and  are  termed  cycle  decks. 
The  exhaust  temperatures  of  any  given  engine  vary  strongly  with  many  factors, 
including  ambient  air  conditions;  flight  speed;  aircraft  pitch,  roll,  and  trim; 
airframe  configuration  and  weight;  and  (of  course)  the  pilot’s  power  lever  set¬ 
ting.  For  systems  analysis  purposes,  one  should  consider  turbine  exhaust  gas 
temperatures  of  450  to  600  K  for  cruise  flight,  600  to  800  K  for  maximum 
unaugmented  thrust,  and  1000  to  1500  K  for  augmented  (afterburning)  thrust. 
Fan  exhaust  temperatures  may  range  from  about  350  to  450  K. 

Rotary-wing  aircraft  have  the  added  complexities  of  rotor  downwash  and 
the  ability  to  hover,  complicating  convection  estimates.  A  reasonable  first 
estimate  is  to  compute  a  recovery  temperature  based  on  a  vector  addition  of 
forward  and  downwash  speeds. 

Missiles  can  pose  a  difficult  thermal  problem  because  of  their  high  accel¬ 
erations  and  Mach  numbers.  In  most  cases,  however,  their  enormous  exhaust 
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plume  emission  dominates  the  body  signature  (even  in  spectral  bands  such  as 
8  to  12  jxm).  However,  the  analyst  must  sometimes  consider  scenarios  with  a 
missile  postburn  phase,  where  the  plume  has  stopped,  or  with  trajectories 
where  low  air  pressure  has  cooled  the  plume  sufficiently  to  stop  any  combustion 
in  the  external  plume,  giving  it  a  weak  signature.  The  latter  phenomenon 
depends  on  many  parameters  and  is  very  hard  to  predict. 

When  missile  body  emissions  are  important,  they  are  transient  in  nature 
and  quite  dependent  on  missile  materials  and  trajectory.  During  the  boost 
phase,  the  missile  accelerates  continuously,  leading  to  continuous  increase  in 
the  recovery  temperature.  The  skin  temperature  T  will  lag  behind  Tr  because 
of  finite  thermal  response  time  and  radiative  heat  loss.  An  upper  bound  tem¬ 
perature  is  certainly  given  by  Tr .  For  another  level  of  accuracy,  one  must 
assume  the  skin  to  have  infinitely  small  response  time,  and  to  balance  the 
convective  and  radiative  terms: 

h(Tr  -  T)  -  eoT4  +  tmv<rTinv  =  0  ,  (6.13) 


where  T  is  the  desired  skin  temperature,  Tr  the  (instantaneous)  recovery 
temperature,  h  the  convective  heat  transfer  coefficient,  s  the  body  thermal 
emissivity,  and  a  is  the  Stefan-Boltzmann  constant.  The  factor  Tenv  represents 
an  average  environmental  temperature  (earth,  sky,  clouds);  its  value  is  not 
critical.  Similarly,  8env  is  the  average  environmental  emissivity.  For  simplicity 
we  take  a  simple  estimate  of  h  for  a  flat  plate  in  a  turbulent  flow: 


h  =  CppUS 


(6.14) 


where  Cp  is  the  ambient  air  heat  capacity  at  constant  pressure,  p  is  the  ambient 
air  density,  U  the  flight  speed,  and  S  the  Stanton  number.8  A  value  for  S  of 
1  x  10 “3  is  sufficient  for  present  purposes.  The  Stanton  number  for  a  flat 
plate  in  a  turbulent  flow  depends  on  density,  velocity,  and  distance  from  a 
leading  edge,  but  only  to  the  one-fifth  power.  A  change  in  flow  parameters  by 
a  factor  of  32  is  thus  needed  to  halve  or  double  S. 

As  an  example,  consider  the  typical  values  of  h  =  100  W/m2  K”1,  Tenv  = 
280  K,  and  e  =  0.9.  With  a  =  5.75  x  10~8  W/m2  K"4  and  Tamb  -  280  K,  we 
can  estimate  T  versus  the  flight  Mach  number,  using  Eqs.  (6.12)  and  (6.13). 
Table  6.5  lists  T  and  Tr  for  these  conditions  and  three  different  Mach  numbers. 
The  example  shows  how  both  the  recovery  temperature  Tr  and  the  radiative 
cooling  (the  difference  between  T  and  7V)  grow  sharply  with  Mach. 

Solar  heating  depends  largely  on  the  amount  of  atmosphere  the  sunlight 
passes  through  (a  function  of  altitude  and  solar  elevation  angle),  surface  ori- 


Table  6.5  Estimates  of  Skin  Temperature  T  and  Recovery  Temperature  Tr  Versus 
Mach  Number  M  for  a  Set  of  Example  Conditions 


M 

0.8 

1.5 

2.5 

Tr  (degrees  kelvin) 

310.5 

387.1 

577.5 

T  (degrees  kelvin) 

309.3 

379.9 

537.8 
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entation  to  the  sun,  and  the  convective  rate.  When  convection  dominates  con¬ 
ductive  and  radiative  losses,  the  temperature  rise  resulting  from  the  sun  can 
be  approximated  by 

A  m  Otsun^solC-^sun  '  A/surf) 

Ai  sun  =  • 

In  this  equation,  aSUn  represents  the  surface’s  solar  absorptivity  (between  0 
and  1);  Eso\  is  the  solar  irradiance  at  the  object,  normal  to  the  sun’s  direction 
(integrated  over  all  wavelengths);  and  Ns un  and  iVsurf  are  unit  vectors  toward 
the  sun  and  normal  to  the  surface.  The  factor  h  is  the  convective  heat  transfer 
coefficient,  as  previously  described.  Typical  values  of  these  factors  are  asun  = 
0.7,ESO\  -  1000  W/m2,  and  h  =  100  W/m2K_1.  The  corresponding  temperature 
increase  resulting  from  the  sun  would  then  be  7  K  for  a  surface  directly  facing 
the  sun. 

Temperatures  of  ground  vehicles  and  ships  are  usually  difficult  to  estimate 
for  a  number  of  reasons.  First,  the  absence  of  high-speed  motion  reduces  the 
dominance  of  convection  on  the  temperature;  the  convective  term  may  be  quite 
large  or  quite  small.  Second,  thick  armor  on  such  vehicles  has  a  large  heat 
capacity,  leading  to  nonequilibrium  conditions.  Reduced  convection  leads  to 
increased  solar  heating,  which  is  strongly  directional;  the  object  will  be  non- 
uniformly  heated.  The  combination  of  low  convection  and  thick  materials  leads 
to  significant  three-dimensional  heat  transfer  effects.  Internal  engine  heating, 
for  example,  can  spread  through  a  vehicle  over  long  time  periods.  Many  other 
effects  can  also  be  important,  such  as  condensation,  evaporation,  rain,  snow, 
mud,  sea  spray,  and  shadowing  by  local  objects. 

These  considerations  warn  us  against  attempting  an  accurate  thermal  es¬ 
timate  without  a  sophisticated  model.  To  achieve  even  a  first-order  estimate, 
the  analyst  must  consider  the 

•  materials,  thicknesses,  and  orientations  of  the  surfaces  in  view 

•  prevailing  weather  and  its  recent  history 

•  object’s  location  and  motion. 

The  most  simple  estimate  would  be  of  steady-state  conditions,  made  by  a 
thermal  balance  of  convective,  conductive,  and  radiative  terms.  However,  un¬ 
less  one  surface  is  in  strong  thermal  contact  with  another  one,  or  with  a  heat 
source,  a  first-order  balance  can  usually  neglect  conduction.  Typically,  how¬ 
ever,  one  must  consider  radiative  absorption  from  the  sun,  sky,  and  the  local 
terrain. 

For  a  systems  estimate,  one  can  expect  a  sunlit  surface  to  be  heated  by  5 
to  50°C  above  the  ambient  air  temperature,  in  the  absence  of  rain,  spray,  etc., 
on  a  day  with  at  least  partial  sun.  During  a  clear  night,  most  surfaces  can 
radiate  heat  more  efficiently  than  the  sky  does,  giving  a  net  cooling  effect. 
Temperatures  below  that  of  the  air  are  common.  Cloud  cover  lessens  both  the 
amount  of  solar  heating  and  of  nighttime  cooling. 

6.7  OPAQUE  SURFACE  REFLECTIONS  AND  EMISSIONS 

The  general  equation  for  reflection  of  light  from  an  incident  direction  (0i  ,4>D 
into  direction  (0o,^o)  is 
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dLref(0O,<J>o)  =  f(Qi,<bi’M,<bo)dEinc{Qi,$i)  ,  (6.15) 

where  all  angles  are  measured  relative  to  the  reflecting  surface  (i.e.,  the  zenith 
angles  0  are  measured  from  the  surface’s  normal  vector).  In  this  equation,  dLre f 
is  the  differential  radiance  reflected  from  the  incident  direction,  dEinc  is  the 
differential  incident  irradiance,  and  fr  is  the  surface  bidirectional  reflectance 
distribution  function  (see  Sec.  6.5).  All  three  of  these  terms  are  spectrally 
dependent.  To  get  the  total  radiance  reflected  into  the  observer  direction  one 
must  integrate  over  all  incident  directions: 


LreKQo^o)  ~~  j  f(Qiy$>i  ^Oj^o)  dE‘mc(^i^i)  •  (6.16) 

The  irradiance  from  any  source  can  be  expressed  in  terms  of  that  source’s 
radiance  as 

dEinc  ~  Line  do)  COS(0f)  ,  (6.17) 

where  Line  is  the  source  radiance  toward  the  reflector  and  do)  is  the  differential 
solid  angle  given  by 

da  =  sin(0)  c?0  d§  .  (6.18) 

We  can  then  write 

•Lref(eo,<t>o)  =  J/’(0£,4>i;0o,<i>o)X.inc(©E,4>i)  cos(0,)  sin(0f)  ci0/  rfcfji  .  (6.19) 

The  final  form  of  this  equation  depends  on  the  geometry  of  the  source;  a  point 
source  emits  from  a  single  direction,  a  spherical  source  emits  from  all  direc¬ 
tions.  The  resulting  equations  are  given  in  the  following  for  the  various  sources 
in  the  environment.  The  result  also  depends  on  the  form  of  the  BRDF  function. 
In  Sec.  6.7.4,  we  provide  both  ideal  specular  and  diffuse  terms. 


6.7.1  Solar  Reflections 

The  sun  is  a  uniform  circular  source  that  subtends  an  angle  of  about  0.5  deg 
from  the  earth.  In  most  cases,  it  can  accurately  be  considered  as  a  point  source. 
The  extraterrestrial  solar  irradiance  (measured  perpendicular  to  the  rays)  is 
denoted  by  Eso i(\).  To  get  the  radiance  of  the  sun  we  must  formally  multiply 
ESo\  by  a  Dirac  delta  function  to  express  that  Eso\  comes  from  a  single  direction 
in  space.  Finally,  we  must  include  a  factor  of  the  atmospheric  transmittance 
from  the  sun  to  the  target,  giving  the  expression 

dLinC(0;,<t>;)  =  Lsoit5(0;  -  0s)5(c(>i  -  <|>s)/sin(0s)  .  (6.20) 

The  factor  of  l/sin(0s)  goes  with  the  delta  function  to  give  the  correct  integral 
over  do).  Inserting  Eq.  (6.20)  into  Eq.  (6.19)  gives 


Lref(0O>4*o)  —  £so1TCOS(0s)  fi^s^s ,  0O,<|>o)  ♦ 


(6.21) 
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6.7.2  Earthshine  Reflections 

The  earth  is  an  extended  source  that  can  be  modeled  as  an  infinite  flat  plane 
for  endoatmospheric  targets.  The  radiance  from  the  earth  consists  mainly  of 
thermal  emission  and  solar  reflection,  plus  atmospheric  transmittance  and 
radiance.  Although  it  is  obviously  nonuniform,  a  good  earthshine  approxi¬ 
mation  is  to  assume  a  uniform  temperature  and  reflectance  appropriate  to  the 
region  under  the  target.  We  further  approximate  the  reflectance  and  emittance 
as  being  Lambertian,  with  spectrally  varying  values.  One  can  then  write 

Learth  =  [ L°{rTe)Ee  +  ES0\TS  COs(0s)pe/Tr]T  +  Latm  >  (6.22) 

where  Te,  se,  and  pe  are  the  earth’s  temperature,  emissivity,  and  reflectivity, 
respectively.  In  this  case,  ts  is  the  transmittance  from  the  sun  to  the  earth. 
The  atmospheric  transmittance  and  radiance  terms  t  and  Latm  can  be  simpli¬ 
fied  by  computations  that  use  a  single  representative  path  between  the  earth 
and  the  target. 

6.7.3  Skyshine  Reflections 

The  sky  above  a  target  can,  to  a  first  approximation,  be  considered  an  infinite 
uniform  source,  as  was  the  earth.  This  approximation  will  hold  for  either  clear 
sky  or  a  solid  cloud  deck  above  the  aircraft.  Broken  clouds  would  require  a 
more  sophisticated  approach.  For  clear  sky,  the  only  source  is  atmospheric 
radiance: 


Lsky  —  Latm  •  (6.23) 

A  single  representative  zenith  angle  can  be  used  for  the  atmospheric  path.  For 
a  solid  cloud  deck,  the  source  function  is 


Lcloud  above 


—  L°(TC) £CT  +  Latm  • 


(6.24) 


We  again  assume  a  Lambertian  emitter  for  the  cloud.  For  simplicity  the  cloud 
deck  is  assumed  to  be  thick  to  eliminate  solar  radiation  transmitted  through 
the  cloud. 


6.7.4  Simplified  Equations 

The  BRDF  model  of  Sec.  6.5  can  now  be  combined  with  the  general  reflectance/ 
emittance  equations  and  the  simplified  environmental  radiance  model  of  Sec. 

6.4  to  provide  the  equations  we  use  in  our  model.  The  integral  in  Eq.  (6.19) 
can  be  distributed  over  the  two  terms  of  the  BRDF  model,  each  of  which  can 
be  integrated  easily  in  closed  form.  The  resulting  equation  is 


Lsurf (0r><jV>M  —  £(V)L  (Tgurf'A)  +  Pd(X) 


Learth(^)  sin 


Lsky(^)  COS 


+ 


— (iV  •  S)£soi(X) 


+  Ps(^)Lglint(^)  > 


(6.25) 
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Fig.  6.8  Environmental  sources  of  radiation. 


where  Lgimt  represents  the  radiance  of  the  environment  source  in  the  ideal 
glint  direction  for  the  surface,  either  earth  or  sky  (see  Fig.  6.8).  If  the  glint  is 
from  the  sun,  Eq.  (6.25)  holds  if  an  effective  solar  radiance  is  used: 

LSunQ0  =  Esom(N  •  SWe ff  .  (6.26) 

The  factor  fle ff  is  the  effective  solid  angle  for  the  glint  lobe,  using  the  specular 
BRDF  of  Eq.  (6.9): 

(left  =  tt  sin2(e/2)  .  (6.27) 

A  glint  will  come  from  the  sun  whenever  the  glint  direction  is  within  ±  e/2 
of  the  sun’s  direction. 

Knowledge  of  environmental  radiation  sources,  surface  temperatures,  and 
surface  optical  properties  enables  us  to  calculate  the  radiance  from  any  object 
surface. 

In  Sec.  6.4,  the  irradiance  on  each  of  the  surfaces  of  the  flying  wedge  was 
calculated  for  both  a  medium-  and  long- wavelength  bandpass.  Equation  (6.25), 
the  expression  for  surface  radiance,  can  be  written  in  terms  of  the  irradiance 
values  calculated  in  Sec.  6.4.  If  we  assume  spectrally  averaged  values  over  our 
MWIR  and  LWIR  bandpasses, 
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■^surf  —  8 L°{T)  +  prf(i£earth  "h  Esky  +  ESun)^ 

Ps-^sun^eff  +  P extended^  >  (6.28) 

where  (leff  is  the  solid  angle  from  Eq.  (6.27)  and  ^extended  is  the  surface  irra- 
diance  resulting  from  either  earthshine  or  skyshine  in  the  specular  direction, 

■^extended  =  TrZ/ extended  •  (6.29) 

For  our  example  calculations,  e  has  been  taken  to  be  10  deg.  Thus,  surface 
radiance,  resulting  from  thermal  emission,  and  reflections  of  earth,  sky,  and 
solar  radiation  can  be  estimated  for  each  surface  and  for  the  total  object. 

The  results  of  calculating  the  radiance  of  each  surface  of  the  flying  wedge, 
using  this  expression  and  previously  derived  values  for  attenuated  surface 
irradiance  (whose  values  are  listed  in  Table  6.4),  are  displayed  in  Tables  6.6 
and  6.7,  which  show  the  radiance  contributed  by  each  source  for  each  of  the 
object’s  surfaces.  The  product  of  the  total  radiance  from  all  sources  for  each 
surface  with  its  area  yields  the  radiant  intensity  for  that  surface.  Summing 
the  radiant  intensity  of  each  surface  provides  the  object’s  total  radiant  inten¬ 
sity.  In  Table  6.8,  radiant  intensity  values  for  the  entire  flying  wedge,  as  well 
as  each  surface,  derived  from  the  radiance  values  in  Tables  6.6  and  6.7,  are 
compared  with  the  corresponding  blackbody  (BB)  values  from  Sec.  6.3  for  two 
views. 


Table  6.6  Radiance  by  Source  and  Surface  for  Aft- Ventral  Beam  View  (Attenuated) 


Surface 
Radiance 
(W/m2  sr) 

— 

Thermal 

Emission 

Earth 

Sky 

Solar 

Total 

Pd 

ps 

Pd 

Ps 

Pd 

Ps 

MWIR 

La 

1.28 

0.05 

0.10 

— 

— 

— 

— 

1.43 

Lb 

1.28 

0.02 

— 

0.02 

0.05 

0.02 

— 

1.39 

Lc 

1.28 

0.00 

— 

0.02 

0.05 

0.008 

— 

1.36 

Ld 

— 

surface  not  observed 

— 

_ 

— 

LWIR 

La 

35.7 

1.3 

2.7 

— 

— 

— 

— 

39.7 

Lb 

35.7 

0.7 

— 

0.6 

2.4 

0.0 

— 

39.4 

Lc 

35.7 

0.1 

— 

1.1 

2.4 

0.0 

— 

39.3 

Ld 

— 

surface  not  observed 

— 

— 

— 

Note:  T  =  300  K,  e  ~  0.85,  p d  ~  0.05,  and  ps  ~  0.10. 
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Table  6.7  Radiance  by  Source  and  Surface  for  Nose  View  (Attenuated) 


Surface 
Radiance 
(W/m2  sr) 

Thermal 

Emission 

Earth 

Sky 

Solar 

Total 

Pd 

Pd 

Ps 

Pd 

ps 

MWIR  Sources 

La 

— 

surface  not  observed 

— 

— 

Lb 

— 

surface  not  observed 

— 

— 

Lc 

0.00 

- 

0.02 

0.05 

0.008 

20.7 

22.1 

Ljy 

0.00 

— 

0.02 

0.05 

0.00 

— 

1.35 

LWIR  Sources 

La 

— 

surface  not  observed 

— 

— 

Lb 

— 

surface  not  observed 

— 

— 

Lc 

0.1 

— 

1.1 

2.4 

0.0 

6.2 

45.5 

Ld 

0.1 

— 

1.1 

2.4 

0.0 

— 

39.3 

Numerical  0.0  indicates  too  small  to  include;  —  indicates  component  does  not  exist  for  this  view. 


Table  6.8  Total  and  Surface  Radiant  Intensities  Computed  for  a  Blackbody  (BB)  and 

by  Use  of  Eq.  (6.28)  (Em-Ref) 


Radiant  Intensity  (W/sr) 

Ia 

Ib 

lc 

Id 

Total 

MWIR 

Beam  view:  BB 

31.5 

— 

74 

Em-Ref 

28.6 

— 

68 

Nose  view:  BB 

— 

— 

32.7 

32.7 

65 

Em- Ref 

— 

— 

481.8 

29.4 

511 

LWIR 

Beam  view:  BB 

wmm 

621.6 

— 

Em- Ref 

wsm 

583.1 

825.1 

— 

— 1: 

Nose  view:  BB 

— 

— 

915.6 

915.6 

1831 

Em- Ref 

— 

— 

991.9 

856.4 

1848 
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6.8  ENGINE  EXHAUST  PLUMES 

Turbine  engine  and  rocket  motor  exhaust  gases,  often  called  a  plume,  constitute 
an  important  source  of  infrared  radiation.  To  determine  the  plume  radiation 
accurately  the  flow  both  inside  and  outside  the  nozzle  must  be  modeled.  Ex¬ 
haust  plume  transmission  is  also  important,  because  the  airframe,  nozzle,  and 
background  can  be  partially  viewed  through  the  plume,  which  partially  absorbs 
their  radiance.  Complex  numerical  techniques,  utilizing  computational  fluid 
dynamics,  are  required  to  make  radiometrically  accurate  plume  predictions. 
Consequently,  the  approximation  techniques  presented  here  are  useful  only 
for  introducing  plume  radiation  methodologies,  and  for  making  rough  radio- 
metric  estimates.  The  estimation  techniques  shown  here  are  most  readily  ap¬ 
plied  to  aircraft  (turbine  engine)  plumes.  In  contrast,  when  applied  to  missile 
plumes,  estimates  become  very  coarse  due  to  the  existence  of  shock  structure 
and  nonequilibrium  chemistry. 

Turbine  engine  operating  conditions  are  generally  modeled  with  a  cycle  deck , 
which  is  tuned  for  each  specific  type  of  engine.  Cycle  decks  provide  estimates 
of  the  exhaust  flow  parameters  (i.e.,  temperature,  pressure,  velocity,  compo¬ 
sition)  at  the  nozzle  exit  plane  where  an  external  exhaust  flow  field  starts. 
There  may  be  more  than  one  engine  flow,  with  a  significant  amount  of  mixing 
either  within  or  outside  of  the  nozzle.  For  turbojets,  there  is  only  a  single  flow. 
Turbofans  have  a  hot  core  flow  and  a  warm  fan  flow,  which  may  mix  inside 
the  nozzle  for  some  engine  types.  On  some  engines,  the  fan  gases  are  ducted 
separately  all  the  way  to  the  exit  plane,  and  there  the  mixing  begins.  Figure 

6.9  depicts  three  turbofan  engine  nozzle  configurations.  In  the  first  engine 
type,  mixing  occurs  only  outside  the  nozzle,  and  the  cycle  deck  output  can  be 
used.  In  the  second  and  third  engine  types  there  is  partial  or  full  mixing  within 
the  nozzle.  If  the  engine  has  an  afterburner,  that  internal  turbulent  combustion 
may  cause  the  core  and  fan  flows  to  mix  completely,  resulting  in  a  single  flow. 

Formal  computation  of  IR  radiation  in  an  external  plume  proceeds  through 
a  number  of  steps,  starting  with  computation  of  the  nozzle  exit  plane  gas 
conditions,  using  engine  cycle  information,  and  nozzle  mixing  analyses.  The 
exit  plane  conditions  are  used,  along  with  the  ambient  flight  conditions,  to 
compute  the  external  plume  flow  field  and  radiation. 

Some  of  the  same  assumptions  used  to  simplify  a  formal  treatment  of  plume 
flow  fields  can  be  employed  in  simpler  plume  radiation  estimation  techniques. 
The  exit  plane  is  often  assumed  to  be  nonuniform,  but  axisymmetric  about  the 
nozzle  centerline,  because  most  nozzles  in  current  use  are  circular.  Many  air¬ 
craft  are  now  being  designed  with  two-dimensional  (noncircular)  nozzles,  for 
which  more  sophisticated  treatments  must  be  employed. 

Mixing  in  jet  engine  exhausts  is  affected  by  the  core  and  fan  flow  parameters, 
the  nozzle  geometry,  and  structural  elements,  such  as  mixing  vanes.  A  rea¬ 
sonable  simplifying  assumption  is  to  neglect  the  effects  of  the  nozzle  walls  on 
the  mixing. 

Nonuniformity  at  the  engine  exit  can  be  traced  to  several  sources.  The  first 
is  the  radial  flow  variation  at  the  exit  of  the  last  turbine  stage.  This  variation 
is  a  result  of  the  spanwise  work  distribution  in  the  turbine  chosen  by  the 
turbine  designer.  It  varies  with  engine  operating  conditions  but  has  generally 
been  measured  as  part  of  the  engine  development  program.  Another  source  of 
engine  exit  variation  is  the  wake  from  obstructions  in  the  flow  such  as  struts. 
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Fig.  6.9  Diagrams  of  mixing  between  core,  fan,  and  free  stream  flows  for  three  nozzle 
configurations:  (a)  type  1  engine,  (b)  type  2  engine,  and  (c)  type  3  engine. 


Other  observed  nonuniformities  have  not  been  traced  to  specific  causes  but 
may  result  from  a  poor  combustor  pattern  factor  (uniformity). 

As  exhaust  gases  flow  through  a  nozzle,  they  isentropically  expand  and 
contract  because  of  the  varying  cross  section  down  the  nozzle.  For  some  engines, 
the  exit-plane  pressure  is  not  equal  (or  pressure  matched)  to  ambient  pressure 
(particularly  true  with  fixed-nozzle  engines  at  high  power).  Most  modern  aug¬ 
mented  aircraft  are  equipped  with  fully  variable  nozzles  that  expand  the  nozzle 
flow  to  ambient  pressure.  Such  pressure-matched  flow  has  weak  shock  struc¬ 
ture,  so  that  fairly  accurate  results  can  be  obtained  by  manually  computing 
pressure-matched  exit  conditions  from  the  true  exit  conditions. 
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t3>  p3>X3 


Fig.  6.10  Cross-sectional  view  of  plume  showing  specification  of  plume  properties  for  three 
cylindrical  regions. 


6.8.1  Plume  Flow  Properties 

Calculations  of  the  IR  radiation  from  a  plume  require  a  characterization  of 
the  temperature,  pressure,  and  molecular  concentrations  of  the  flow  field.  Axi- 
symmetric  flows  can  be  conveniently  represented  for  radiance  computations 
by  a  set  of  concentric,  cylindrical  shells.  The  flow  properties  must  therefore  be 
known  as  functions  of  the  axial  and  radial  (z,r)  coordinates  within  each  cy¬ 
lindrical  shell. 

As  shown  in  Fig.  6.10,  the  plume  properties  are  assumed  to  be  constant 
within  each  annular  region  between  cylinders.  The  plume  properties,  for  the 
purpose  of  calculating  emission,  are  specified  by  temperature  T ,  pressure  P, 
species  mole  fractions  Xj  ,  and  the  plume  physical  dimensions  of  cylinder  radius 
R ,  and  axial  location  Z.  In  a  detailed  treatment,  the  cross-sectional  properties 
of  the  plume  may  be  specified  at  many  axial  locations  downstream  of  the  exit 
plane. 

To  determine  the  spatial  distribution  of  radiation  in  a  plume,  the  radiation 
transport  must  be  calculated  for  lines  of  sight  through  the  plume. 

6.8.2  Plume  Radiance  and  Transmittance  Calculation 

If  plume  properties  are  defined  along  a  line  of  sight,  the  radiative  transport 
for  that  line  of  sight  can  be  determined.  The  form  of  the  radiative  transport 
equation  can  be  taken  to  be9 

L(\)  =  fSLo(X,T)^  ds  ,  (6.30) 

Jo  ds 

where 
L(A) 

LoiKT) 

t  (A,s) 

s 


=  spectral  radiance  for  line  of  sight  from  0  to  S 
=  Planck  function  spectral  radiance  at  wavelength  A  and 
temperature  T(s) 

=  transmittance  to  the  observer  at  wavelength  A  and  distance 
s  along  line  of  sight 

=  distance  along  line  of  sight  (increasing  in  the  direction  of 
light  travel). 
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Equation  (6.30)  assumes  that  no  scattering  occurs  within  the  plume.  The  plume 
properties  are  assumed  to  be  constant  within  spatial  regions  along  the  line  of 
sight,  allowing  the  integral  to  be  evaluated  piecewise,  and  thus  giving  a 
summation: 

i  =  imax 

LOO  =  2  Lo(X,T;)[t;(X)  -  Ti-i(X)]  ,  (6.31) 

i-  1 

where  i  denotes  the  fth  spatial  region  along  the  line  of  sight  and  n(\)  is  the 
total  transmittance  from  the  outside  edge  of  the  plume  facing  the  observer 
through  the  i’ th  spatial  region.  The  transmittance  from  the  observer  to  the 
edge  of  the  plume  Timax(X)  is  defined  as  equal  to  unity  to  calculate  the  source 
emission.  Note  that  for  a  single  uniform  "slab”  of  gas,  we  would  have 

LOO  =  L0(X,T)[1  -  t(\)]  . 

The  calculation  of  the  spectral  transmittance  along  a  line  of  sight,  t,  can  be 
quite  complex.  When  transmittance  is  computed  at  high  spectral  resolution, 
so  that  the  gas  absorption  is  nearly  constant  at  each  spectral  point,  it  follows 
a  simple  exponential  known  as  Beer’s  law.  Such  resolutions  are  typically  around 
0.1  cm-1.  However,  because  most  passive  infrared  systems  operate  with  spec¬ 
tral  passbands  of  the  order  of  1000  cm-1  wide,  an  analyst  would  need  to 
compute  about  10,000  spectral  points. 

At  coarser  spectral  resolutions  (typically  5  to  20  cm-1),  the  gaseous  ab¬ 
sorption  is  averaged.  Because  the  exponential  of  an  average  value  does  not 
equal  the  average  of  an  exponential,  Beer’s  law  leads  to  inaccuracies  at  low 
and  moderate  resolutions.  The  handbook  by  Ludwig  et  al.9  provides  an  excel¬ 
lent  introduction  to  this  problem. 

One  of  the  most  important  plume  emission  regions  results  from  CO2,  ex¬ 
tending  roughly  from  4  to  5  pm  (2000  to  2500  cm-1).  CO2  is  abundant  in  most 
exhausts,  and  it  is  a  strong  absorber.  Nonafterburning  turbine  engine  exhausts 
are  typically  at  temperatures  of  500  to  800  K  at  the  engine  exit,  thus  the 
Planck  function  peaks  near  the  CO2  region.  (Hotter  exhausts  emit  strongly  at 
shorter  wavelengths,  but  are  still  intense  in  the  4-  to  5-pm  region.)  Fortunately, 
that  CO2  band  has  such  a  dense  line  structure  at  plume  temperatures,  that 
its  absorption  does  not  vary  much  within  10-cm-1  spectral  bins.  Beer’s  law 
can  thus  be  used  with  moderate  validity. 

Optically  active  species  and  their  associated  bands  include:  CO2  (2.7,  4.3, 
15.0  pm),  H2O  (2.7,  6.3  pm),  and  CO  (4.65  pm).  Absorption  coefficients  for 
these  and  other  molecules  can  be  obtained  from  Refs.  9,  10,  and  11.  The  CO2 
4.3-pm  band  model  parameters  of  Bernstein  et  al.11  are  particularly  useful  for 
calculating  exhaust  plume  radiation  in  the  MWIR. 

6.8.3  Estimating  Plume  Radiation  in  the  MWIR 

Calculating  the  radiation  from  exhaust  plumes  is  complex  because  their  shapes 
and  volumes  are  not  fixed  for  all  flight  conditions  and  they  tend  to  be  optically 
translucent.  Aircraft  are  typically  endowed  with  weak  exhaust  plumes,  having 
relatively  low  temperature  gases  (several  hundred  versus  several  thousands 
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of  degrees  Celsius)  and/or  low  concentrations  of  optically  active  molecular 
species.  Radiation  from  such  plumes  are  primarily  confined  to  the  rotational 
band  systems  associated  with  the  exhausted  products  of  combustion,  including 
CO2,  H2O,  and  sometimes  CO.  The  fact  that  these  same  gases  occur  in  the 
surrounding  atmosphere  in  varying  concentrations  adds  considerable  com¬ 
plexity  to  the  process  of  radiation  transport,  and  thus  to  IR  signature  calcu¬ 
lations.  (Radiation  from  hot  gas  can  be  absorbed  by  colder  gas,  which  itself 
radiates  weakly.) 

Systems  that  operate  by  sensing  radiation  at  wavelengths  around  3  to  5  jim 
are  often  specifically  designed  to  detect  radiation  from  hot  CO2,  exploiting  this 
spectral  regime’s  absence  of  water  vapor  absorption  bands.  Although  absorp¬ 
tion  by  atmospheric  water  vapor  is  thus  avoided,  atmospheric  CO2  is  sufficient 
to  significantly  reduce  the  amount  of  radiation  near  the  band  center.  The  hotter 
the  exhaust  gas,  the  more  radiation  emanates  from  wavelengths  far  from  the 
band  center  (the  wings  of  the  band).  Absorption  by  cooler  intervening  gas 
selectively  removes  the  radiation  from  the  band  center,  causing  a  decrease  in 
intensity  at  these  wavelengths.  This  well-known  phenomena  of  band  reduction 
can  be  better  understood  by  examining  the  curves  in  Fig.  6.11,  which  show 
the  absorption  coefficient  (a  measure  of  the  ability  of  the  gas  to  absorb  radia¬ 
tion)  for  CO2  gas  at  different  temperatures. 

IR  technology  that  exploits  radiation  at  longer  wavelengths,  from  8  to  12 
|xm,  exploits  a  spectral  region  that  is  devoid  of  strong  CO2  or  H2O  bands.  In 
fact,  unless  an  aircraft  is  employing  rocket-propelled  or  afterburner-assisted 
flight,  plume  radiation  can  generally  be  neglected  as  a  significant  contributor 
to  the  total  long-wavelength  IR  signature. 


2200  2250  2300  2350  2400 

WAVENUMBER  (cm-1) 


Fig.  6.11  CO2  4.3-|xm  absorption  coefficients  at  different  band  temperatures.  These  values 
have  been  averaged  over  5-cm_1  spectral  bins,  so  that  no  line  structure  is  apparent. 
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In  the  MWIR,  the  plume  may  represent  the  strongest  signature  component 
(depending  on  aspect  and  the  range  to  the  observer)  and  therefore  should  be 
dealt  with  carefully.  In  general,  the  total  radiation  from  a  volume  of  hot  gas 
depends  on  its  transmissivity  t,  which  in  turn  depends  on  the  gas  temperature 
T,  the  concentration  of  emitting  species  x;,  and  their  distribution  throughout 
the  volume  of  the  gas.  The  transmissivity  of  a  gas  along  a  line  of  sight  can  be 
written  using  Beer’s  law  as 


t (T,v)  -  exp 


-HT,v)Xp(^y)D 


(6.32) 


where  P  is  the  gas  pressure;  k(T,v)  is  the  absorption  coefficient  at  temperature 
T  and  wavenumber  v ;  and  D  is  the  distance  through  the  gas  along  the  optical 
path.  We  define  the  optical  depth  to  be 

u( v)  =  k(T,v)Xp(^B  ■  (6.33) 

For  optical  depth  greater  than  1,  the  gas  absorbs  strongly,  and  radiates  ap¬ 
proximately  as  a  blackbody. 

Exhaust  plumes  can  generally  be  divided  into  regions  within  which  both 
temperature  and  species  concentrations  can  be  assumed  for  simplicity  to  be 
constant.  The  bulk  of  the  radiation  from  jet  engine  exhaust  plumes  comes  from 
the  vicinity  of  the  exit  plane  in  a  region  called  the  inviscid  core.  As  much  as 
three-quarters  of  the  total  plume  radiation  may  be  generated  within  a  length 
of  plume  shorter  than  the  structural  length  of  the  aircraft.  Cooler  plume  regions 
emit  more  weakly  and  are  more  easily  absorbed  by  the  cool  atmospheric  gas. 
It  is  thus  important  for  IR  calculations  to  estimate  the  conditions,  size,  and 
shape  of  the  hottest  exhaust  gas. 

For  a  circular  axisymmetric  nozzle,  the  inviscid  core  is  roughly  cone  shaped 
(see  Fig.  6.12).  The  base  of  the  cone  is  the  area  of  the  nozzle  exit  (with  radius 
Ro).  Its  length  L  has  been  empirically  determined12  to  be  dependent  on  exhaust 
Mach  number  Me,  an  eddy  mixing  coefficient  k,  and  the  density  differential 
between  the  ambient  free  stream  po  and  the  exhaust  gas  pj : 


Ape  —  pj  / po  , 


so  that 


L  =  RoXMApe)'/2  ,  (6.34) 

where 

k  =  0.08(1  -  0.16  Mc)( Apcr0'22  ,  (6.35) 

and  X  is  a  characteristic  axial  scale  length  empirically  found12  to  be  equal  to 
0.70.  (Note  that  assuming  pressure  matched  conditions,  Ape  ~  1.0.)  For  an 


SIGNATURE  PREDICTION  AND  MODELING  335 


of 

Aircraft 

Fig.  6.12  Simplified  aircraft  jet  engine  exhaust  plume. 


exit  Mach  number  equal  to  1.4,  for  example,  k  =  0.062  and  the  length  of  the 
inviscid  core  is  11.3  times  the  nozzle  radius. 

Estimating  the  radiant  intensity  of  an  exhaust  gas  at  MWIR  wavelengths 
entails  calculating  an  average  plume  radiance  and  an  effective,  unobstructed 
plume  core  projected  area.  Because  the  plume  is  translucent,  its  radiance  is 
spatially  variable  even  assuming  an  exhaust  gas  whose  inviscid  core  is  at 
uniform  temperature,  pressure,  and  species  concentration.  Depending  on  the 
core  geometry  (which  depends  on  the  nozzle  shape),  different  lines  of  sight 
penetrate  different  column  lengths  of  optically  active  gas. 

The  degree  of  plume  translucence  along  any  line  of  sight  is  determined  by 
the  optical  depth  of  the  emitting  gas,  and  is  spatially  variable  over  the  plume. 
The  average  optical  depth,  over  a  plume  whose  properties  are  constant  within 
a  volume,  can  be  estimated  by  solving  for  the  average  line  of  sight  path  length 
x  through  a  plume.  For  a  plume  seen  broadside, 


volume 

area 


when  Ap  is  the  projected  area  of  the  plume. 
For  a  cone  viewed  broadside,  the  solution  is 

2 

_  volume  _  {^RqL)IZ  _  ttRo 
area  RqL  3 


For  example,  iftfo  =  0.625  m,  then  L  =  7.06  m  and  x  =  0.654  m.  This  average 
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pathlength  can  be  used  to  estimate  an  average  optical  depth  for  a  homogeneous 
cone  shaped  plume,  as  well  as  an  average  pathlength  (APL)  transmittance 


/ 273\_ 

u  =  «co2Xco2pl  ~jT  Jx  > 


(6.36) 


.APL  _ 


exp(-  u) 


(6.37) 


Note  that  calculating  the  average  transmittance  t,  and  therefore  a  true  average 
radiance,  entails  solving 


J  f  t (y,z)  dydz  jj exp[  -  u{y,z)\  dy 
f  fdy  dz  Ap 


a  much  more  difficult  proposition,  especially  for  off-beam  perspectives  of  the 
plume.  Instead,  we  can  consider  the  plume  radiance  for  two  limiting  cases:  an 
optically  thin  and  thick  gas. 

In  the  optically  thin  case,  u  is  everywhere  small,  and 


’thin  ~  e  ~  1  U  —  1  fcc02XC02P  rn  ) x  > 


(6.38) 


=  1  -  Kx  , 


where 


(6.39) 


K  -  kco2xco 2P 


Because  we  are  considering  a  uniform  region  of  gas,  we  can  write 

I4fit  =  (1  -  ^Lo  ~  KxLo  . 

The  total  radiant  intensity  I  from  the  plume  is  then 


(6.40) 


(6.41) 


=  LdA  ~  AJL&k 


(6.42) 


I^n  =  ApKxLo  . 


(6.43) 


However,  Apx  is  an  effective  volume  V  of  the  plume,  so 
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=  KLoV  .  (6.44) 

Thus,  in  the  optically  thin  case,  the  radiant  intensity  of  the  plume  is  propor¬ 
tional  to  the  volume.  Although  a  broadside  perspective  was  initially  assumed, 
the  optically  thin  limit  is  also  true  for  the  more  general  case  of  any  observer 
direction  that  provides  an  unobstructed  view  of  the  plume.  _ 

In  the  optically  thick  limit,  the  transmissivity  is  near  zero,  so  L  *  Lo.  In 
this  case,  the  radiant  intensity  is  proportional  to  the  plume  projected  area.  In 
most  normal  circumstances,  the  plume  will  be  neither  completely  optically 
thin  or  thick,  so  the  value  of  the  radiance  will  be  intermediate  to  the  two 
extremes.  When  the  observer’s  perspective  changes  from  its  direct  beam  view, 
the  average  path  length,  which  was  used  to  determine  a  representative  optical 
depth  and  the  gas  transmittance,  will  also  change.  For  near  broadside  views, 
the  off-beam  average  optical  depth  x'  can  be  taken  to  be 

x'  =  jc/sina  , 

where  a  is  the  aspect  angle  measured  from  nose-on. 

To  calculate  an  exhaust  plume’s  radiant  intensity,  its  projected  area  must 
be  determined.  Estimating  the  projected  area  of  the  inviscid  core  of  exhaust 
gases  exiting  nonaxisymmetric,  rectilinearly  shaped  nozzles  can  be  accom¬ 
plished  by  treating  the  plume  as  if  it  were  comprised  of  individual  flat  surfaces. 
In  that  case,  calculating  the  projected  area  of  plume  surfaces  proceeds  in  the 
same  manner  as  for  the  airframe.  Calculating  the  plume  projected  area  for 
curvilinear  exhaust  nozzles  may  be  more  difficult.  For  example,  a  circular 
nozzle  produces  a  conically  shaped  inviscid  core.  The  projection  of  a  cone  seen 
broadside  is  a  simple  triangle.  Viewing  the  tail  of  the  aircraft  presents  a 
circular  plume.  For  aspect  angles  between  broadside  (90  deg)  and  tail  (180 
deg),  the  projected  shape  may  be  represented  by  a  combination  of  ellipse  and 
triangle.  The  projection  of  a  cone  shaped  inviscid  core  may  present  one  of  four 
different  views,  depending  on  the  aspect  angle  a  or  the  equivalent  off-broadside 
angle  (4>  =  ot  —  90): 

1.  direct  beam  view  (a  =  90  deg  or  4>  =  0  deg):  triangular  cross-sectional 
area 

2.  off-beam  view  (0  deg  <  <\>  <  (|>i):  full  ellipse  area  plus  small  extended 
triangle 

3.  near-tail  view  (<f>i  <  <j>  <  90  deg):  full  ellipse  area 

4.  tail  view  (<J>  =  90  deg):  full  circular  area, 

where  the  value  of  c|>i  is  determined  by  the  ratio  of  nozzle  radius  Ro  and  core 
length  L.  These  possibilities  can  be  represented  by  a  triangular  surface  (the 
inviscid  core)  attached  orthogonally  to  a  circular  surface  (the  nozzle),  shown 
in  Fig.  6.13. 

The  constant  4>i  is  the  aspect  angle  at  which  the  triangle’s  projected  length, 
L  cos<j>,  is  less  than  the  semiminor  axis  of  the  ellipse,  or 


L  coscju  =  Ro  sinc|>i  , 


(6.45) 
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(a)  a  =  90° 
0=0° 


(b)  90°<a<a1 
0°  <0  <  01 


L  Cos  0 


Full  elliptical  area  plus 
small  triangular  area 


(c)  a-i  <  a  <  1 80° 
01  £0  <90° 


L  Cos  0 


Elliptical  area 
(triangle  subtended 
by  ellipse) 


(d)  a  =  180° 
0  -  90° 


Fig.  6.13  Four  different  perspectives  for  simplified  model  of  a  conical  plume  each  of  which 
demands  specific  approach  to  calculating  plume  area. 


L_ 

Ro 


sin4>i 

C0S<|)1 


=  tan<()i  , 


4>i  =  tan  1 


(6.46) 

(6.47) 


For  aspect  angles  between  0  deg  and  <|>i,  the  projected  area  of  the  inviscid  core 
is  comprised  of  the  area  of  the  full  ellipse  and  the  small  portion  of  the  plume 
that  lies  beyond  the  boundaries  of  the  ellipse.  In  this  case  the  approximate 
projected  area  is 


Ro 


Ap  =  Ro  sinc[>  +  t - ~(L  cos<|>  -  Ro  sine))) 

L  cosep 


(6.48) 


For  a  nozzle  whose  radius  is  62.5  cm  and  a  plume  whose  inviscid  core  length 
is  7.06  m,  <$n  =  85  deg.  An  observer  at  110-deg  aspect  (<(>  =  20  deg)  sees  a 
plume  core  projected  area  of  4.3  m2.  Because  the  plume  is  translucent  and 
conical,  the  effective  projected  area  may  be  somewhat  less,  because,  at  the 
edges  of  the  cone,  the  column  length  of  radiating  gas  is  much  less  than  at  the 
center.  Thus,  the  value  of  the  radiant  intensity  calculated  for  the  entire  core 
may  be  somewhat  inflated. 
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More  important,  radiation  from  the  inviscid  core  must  pass  through  a  region 
of  mixed  exhaust  and  ambient  gases  (see  Fig.  6.12).  This  region  diverges  into 
the  ambient  free  stream  with  distance  downstream  of  the  nozzle.  The  warm 
gas  contains  exhaust  products  that  are  very  effective  in  absorbing  the  radiation 
from  the  core,  particularly  at  wavelengths  near  the  band  center.  Temperatures 
in  this  region  vary  radially,  being  hot  near  the  core,  and  cold  (ambient)  at  the 
outer  edge.  We  approximate  this  region  by  assigning  uniform  warm  gas  to  the 
inner  half  of  the  diverging  sheath,  as  shown  in  Fig.  6.14.  For  the  example 
discussed  in  the  following,  we  take  the  pathlength  of  this  warm  intervening 
absorbing  gas  to  be  equal  to  the  difference  between  the  nozzle  radius  and  half 
the  average  core  pathlength  (3c/2).  We  must  calculate  both  the  transmittance 
and  emission  from  this  shroud  of  warm  gas  surrounding  the  inviscid  core. 
Thus,  calculating  a  plume’s  radiant  intensity  entails  first  calculating  the  op¬ 
tical  depth,  transmittance,  and  radiance  for  two  separate  gas  regions.  These 
calculations  are  most  simply  performed  using  values  of  absorption  coefficient 
for  small  spectral  regions  or  sub-bands  that  span  the  molecular  band.  The 
resulting  radiances  are  then  spectrally  integrated  to  obtain  the  average  source 
radiance  for  each  gas. 

Tables  6.9  and  6.10  show  the  results  of  radiance  and  transmittance  calcu¬ 
lations  for  a  plume  observed  from  110-deg  aspect  (20  deg  tailward  of  beam). 
Table  6.9  gives  the  spectral  sub-band  results  of  radiance  and  transmittance 
for  the  sheath  of  warm  gas  surrounding  the  hotter  inviscid  core.  The  core 
radiance  and  transmittance  values  are  shown  in  Table  6.10,  which  also  lists 
the  spectral  sub-band  radiance  transmitted  through  the  warm  sheath.  Addition 
of  the  sub-band  radiance  values  from  hot  core  and  warm  sheath  represent  a 
total  average  source  radiance  for  the  plume.  The  absorption  coefficients  for 
this  computation  were  taken  from  Fig.  6.11. 

The  product  of  the  average  source  radiance  for  each  gas,  times  its  projected 
area,  yields  the  radiant  intensity  from  that  region.  For  the  warm  sheath  sur¬ 
rounding  the  inviscid  core,  the  projected  area  is  of  a  concentric  cylinder  whose 

Hot  Conical  Core 


<TC.  Pc  Xc) 


Fig.  6.14  Geometry  of  plume  approximation  showing  conically  shaped  inviscid  hot  core  of 
length  L,  with  properties  Tc,  Pc,  and  \c,  embedded  in  a  cylindrical  sheath  of  warm  gas, 
whose  properties  are  defined  by  Ts,  Ps,  and  xs- 
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Table  6.9  Transmittance  and  Radiance  for  the  Warm  Sheath  of  Mixed  Gases 
Surrounding  the  Inviscid  Core,  at  520  K,  0.02  Mole  Fraction  of  CO2,  and  0.89 
Atmospheres  of  Pressure,  Observed  at  110-deg  Aspect  with  Average  Column 

Length  of  31.69  cm 


Spectral 

Sub-Band 

(cm-1) 

Average 
Absorption 
Coefficient 
at  STP 
(cm-1) 

Warm  Gas 
Blackbody 
Radiance 
(W/sr  m2) 
LW0(T,  v) 

Warm  Gas 
Transmittance 

T  W 

Warm  Gas 
Emitted 
Radiance 
(1  -  tw)L*o 

2216-2255 

0.0 

10.71 

1.0 

0.0 

2256-2285 

1.2 

7.570 

0.70 

2.2 

2236-2315 

13.0 

7.245 

0.021 

7.1 

2316-2345 

40.0 

6.932 

7.2(  —  6) 

6.9 

2346-2375 

54.0 

6.628 

l.K-7) 

6.6 

2376-2405 

1.2 

6.335 

0.70 

1.90 

Total  (spectrally  summed) 

24.7 

Table  6.10  Transmittance  and  Radiance  for  the  Inviscid  Core  Gas  at  760  K,  0.04  Mole 
Fraction  of  CO2,  and  0.89  Atmosphere  Pressure,  Observed  at  110-deg  Aspect,  with 
Average  Column  Length  of  65.45  cm 


Spectral 

Sub-Band 

(cm-1) 

Average 
Absorption 
Coefficient 
at  STP 
(cm  x) 

Hot  Gas 
Blackbody 
Radiance 
(W/sr  m2) 
LHo(T,v) 

Hot  Gas 
Trans¬ 
mittance 

T  H 

Hot  Gas 
Emitted 
Radiance 
(1  -  T h)L"0 

Warm 

Gas 

Trans¬ 

mittance 

T  W 

Hot 

Transmitted 
Radiance 
(1  -  ih)twLh0 

2216-2255 

0.51 

37.3 

1.0 

37.3 

2256-2285 

0.023 

54.4 

0.70 

38.1 

2236-2315 

5.4(  — 8) 

54.7 

0.021 

1.1 

2316-2345 

53.7 

CN 

1 

53.7 

7.2(  -6) 

0.0 

2346-2375 

41.0 

52.7 

1.2(  — 15) 

52.7 

1.1(~7) 

0.0 

2376-2405 

4.0 

51.6 

0.035 

49.8 

0.70 

34.9 

Total  (spectrally  summed) 

111.4 

radius  is  equal  to  that  of  the  nozzle  (R0).  In  this  case,  the  projected  area  of 
such  a  cylinder  is  8.7  m2  and  the  total  radiant  intensity  from  the  entire  plume 
is  about  700  W/sr. 


6.9  SUMMARY 

Employing  the  estimation  techniques  compiled  in  previous  sections,  it  is  pos¬ 
sible  to  calculate  an  approximate  intensity  for  the  flying  wedge,  which  includes 
the  most  important  contributing  phenomena.  This  approximation  includes  ob¬ 
ject  radiation  resulting  from  thermal  energy  from  both  hardbody  and  exhaust 
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gases.  Environmental  sources  of  reflected  radiation  are  accounted  for  including 
the  sun,  the  earth,  the  atmosphere,  and  clouds. 

The  integrated  source  radiant  intensity  of  the  flying  wedge,  flying  in  straight 
and  level  flight,  at  1000  m,  at  Mach  number  0.5,  under  a  thick,  but  not  total, 
overcast  (the  object  is  illuminated  by  the  sun)  is  found  by  simply  summing 
each  of  the  contributing  sources  of  radiation.  It  is  instructive  to  understanding 
the  signature  phenomenology  to  decompose  the  total  source  radiant  intensity 
into  the  contributions  from  each  source  from  each  surface.  As  illustrated  in 
previous  sections,  the  relative  importance  of  different  radiation  mechanisms 
depends  on  the  viewing  aspect. 

The  relative  contribution  from  each  source  of  radiation  for  the  flying  wedge 
is  revealed  by  summing  the  individual  amounts  due  to  each  mechanism.  This 
is  shown  for  each  aspect  and  bandpass  in  Table  6.11.  Thus,  for  the  observer 
with  a  view  slightly  aft  and  below  the  object’s  beam,  the  total  source  radiant 
intensity  is,  at  MWIR  wavelengths, 

/beam  =  770  W/sr  , 

and  at  LWIR  wavelengths, 

/beam  =  1940  W/sr  . 

For  the  observer  with  a  nose  view,  the  total  source  radiant  intensity  is,  at 
MWIR  wavelengths, 

/nose  =  510  W/sr  , 

and  at  LWIR  wavelengths, 

/nose  =  1850  W/sr  . 

When  a  solar  glint  is  observed  in  the  MWIR,  or  when  a  hot,  optically  thick 
exhaust  plume  is  in  view,  these  values  depart  significantly  from  those  obtained 
by  assuming  the  object  behaves  as  a  simple  blackbody.  The  real  difference  can 
be  seen  in  the  mechanisms  that  produce  the  radiation  from  each  surface,  and 
in  their  variation  with  observed  aspect. 


Table  6.11  Radiant  Intensity  in  Watts  per  Steradian  Contributed  by  Each  Source,  for 

Each  Wavelength  and  Case 


Case  and 
Bandpass 

Thermal 

Emission 

Earthshine 

Reflections 

Skyshine 

Reflections 

Solar 

Reflections 

Total 

Ventral 
beam— MWIR 

63.1 

2.3 

2.5 

0.5 

700.0 

770 

Nose— MWIR 

55.8 

0.0 

3.1 

451 

0.0 

510 

Ventral 
beam— LWIR 

1760 

67.0 

118 

0.0 

0.0 

1940 

Nose— LWIR 

1560 

4.4 

153 

135 

1850 
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The  atmospheric  transmission  losses  from  the  object  to  the  observer,  par¬ 
ticularly  important  when  viewing  an  exhaust  plume,  can  be  accommodated  by 
estimating  an  in-band  transmittance,  or  by  using  atmospheric  models,  such 
as  the  Air  Force  LOWTRAN  series.  Intersurface  reflections  can  be  estimated 
by  treating  surface  pairs  in  a  manner  similar  to  the  calculation  for  surface 
point  source  illumination. 

Other  aspects  are  calculated  in  a  similar  fashion  to  the  approach  presented 
here.  More  complex  targets  typically  require  a  significant  increase  in  the  num¬ 
ber  of  surfaces  that  must  be  modeled.  In  this  event,  the  advantage  of  using 
numerical  techniques  is  clear. 
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exhaust  plume  emission,  332-341 
skyshine,  317-318,  341 
solar  irradiance,  315,  317-318 
solar  reflections,  341 
source  radiant  intensity,  341 
surface  radiance,  327-328 
thermal  emission,  341 
8-  to  12-pm  spectral  band,  9,  32,  302 
aircraft  surface  blackbody  radiant 
intensity,  313 

background  temperatures,  205-206 
band  selection,  32 
earthshine,  317-318 
skyshine,  317-318 
solar  irradiance,  315,  317-318 
solar  reflections,  341 
source  radiant  intensity,  341 
surface  radiance,  327-328 
thermal  emission,  341 

Aberrations,  optical 
chromatic,  18 

Absorption,  atmospheric,  314,  332-333 
Absorption  coefficients,  332-333,  339 
Adhesives 

for  lens  barrels,  154,  156 
for  lens  mounts,  143-144 
for  mirror  mounts,  176-177 
for  prism  mounts,  136-137 
for  window  mounts,  134 
Aircraft,  250-251,  302 
engine  hot  parts,  302 
geometry,  307-312 
plumes,  302,  329-340 
surface  radiant  intensity,  312-313 
thermal  model,  320-323 
Algorithms,  tracking 

adaptive  reference  correlation,  276-277, 
280 

binary  centroid,  254—260,  278-280 
breaklock  detection,  287-288 
circular,  257 

correlation,  271-276,  278-280,  283 


fixed  reference  correlation,  280 
gate  construction,  281-285 
intensity  centroid,  260-263,  280 
maximum  likelihood  estimator,  263-271, 
280 

predictor/corrector  algorithm,  268 
segmentation,  258 

target  location  estimation,  254-280,  292, 
294 

thresholded  intensity  centroid,  280 
Aliasing,  44-48,  101,  103,  106 
Aluminum,  167,  188-190,  192 
athermalization,  178 
thermal  coefficient  of  expansion,  170 
thermal  distortion  parameter,  169 
Ancillary  data,  251,  252 
Apparent  quantities,  30-31 
Arrays,  detector,  66-68 
scanning,  103 
staring,  103,  106 
Astigmatism,  170-171 
Athermalization,  177-183 

athermal  compensators,  179-183 
bimetallic  compensators,  181-183 
focus,  180 

graphite  epoxy  composites,  182-183 
lens  power,  179 
metering  rods,  182-183 
thermo-optic  coefficients,  179-180 
same  material  athermalization,  178 
structural,  177-178 
Atmospheric  attenuation,  305,  317 
Atmospheric  transmission,  apparent,  30 
Autocorrelation  function,  33-34 
Automatic  gain  control,  273 
Automatic  target  recognition,  286-287 
Averaging  aperture  (unit  cell),  7 

Background  parameters,  266 
Background  radiance,  305 
Background-limited  infrared  photodetection 
(BLIP),  23 
and  detectivity,  27 
and  NETD,  27-28 
Backgrounds 

modeling,  64-65 
Bandwidth,  equivalent,  38-39 
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Bar  targets,  42-43,  81-83,  91,  94,  200,  232, 
235,  238-240 
Beer’s  law,  332,  334 
Beryllium,  167,  188-190 
athermalization,  178 
thermal  coefficient  of  expansion,  170 

Bias,  258-260 
Bias  error,  292 

Bidirectional  reflectance  distribution  function 
(BRDF),  318-320,  323-326 
Blackbodies,  302,  328,  334 
Bose-Einstein  equation,  12 
Breaklock  detection,  253,  280,  287-288.  See 
also  Loss  of  lock 
Breaklock  flag,  289 
Breaklock  test,  288 

Carbon  dioxide,  332-333 
absorption  coefficient,  333 
Carbon  monoxide,  332-333 
Central  limit  theorem,  38-39 
Central  ordinate  theorem,  39 
Centroid  trackers,  254-263 

binary,  254-260,  262,  278-280,  281 
gate  size,  281 
intensity,  260-263,  280 

thresholded  intensity  centroid,  261,  280 
Charge  transfer  devices,  101,  103-104 
modulation  transfer  function,  41 
phase  transfer  function,  41 
Charge-coupled  devices,  103-104 

modulation  transfer  function,  103-104 
Classification,  258 

Clutter,  32-35,  52,  253,  260,  282,  293 
diurnal  variation  of,  34-35 
and  search  detection  probability,  112 
Collimators,  201,  206-208 
clear  aperture,  207 
Comb  functions,  45 
Contrast 
apparent,  9 
irradiance,  303,  305 
radiant  intensity,  305 

Contrast  transfer  function,  199,  201,  232-236 
phasing  effects  on,  233 
relationship  to  MTF,  232-233,  236 
test  configuration,  233-234 
Control  theory,  247,  251 
Convection,  321-323 

Convective  heat  transfer  coefficient,  322,  323 
Correlation  trackers,  271-276,  278-280 
gate  size,  282-283 
Covariance,  270,  275 
Covariance  matrix,  276 
Cramer-Rao  bound,  270,  275 
Cross-correlation,  273 


Dark  current,  22,  198 
Data  fusion,  279 
Degrees  of  freedom,  10 
Detection,  7,  62,  84-91.  See  also 
Discrimination;  Search;  Target  acquisition 
FLIR  example,  86-91 
military  detection,  63 
probability  of,  84 
pure  detection,  62,  84-91 
Detectivity,  70-71 
2T(300),  25 
D'( 500),  24 
specific,  19,  70 
spectral,  19 

Detector  electronics,  modeling  of,  71 
Detector  spectral  response,  4,  7 
Detectors,  semiconductor 
spectral  detectivity,  21 
Diffraction  cutoff  frequency,  7 
Dirac  delta  function,  44-45 
Discrete  data  transfer  function,  294 
Discrete  time  transfer  function,  294 
Discrimination,  62,  91-99.  See  also  Detection; 
Target  acquisition 
discrimination  detection,  62 
FLIR  example,  94-96 
higher  order,  91-99 
Johnson  methodology,  91-92 
loadline  procedure,  96-97 
N60,  92,  97,  98 
orientation,  63 

prediction  methodology,  93-94 
target  classification,  63,  99 
vs  target  critical  dimensions,  92 
target  identification,  97,  99 
target  recognition,  63,  97 
Displays 

MTF,  71-72,  100 
Distortion 

of  windows,  124 

Domes.  See  Windows  and  domes 
Drift  error,  292 
Dynamic  range,  7,  198 

Earthshine,  302,  305,  316-318,  325,  327,  341 
Electrical  efficiency  (pulse  gain  factor),  29 
Electro-optical  imaging  chain,  63-77 
atmospheric  effects,  65-66 
absorption,  65 
LOWTRAN  7,  66 
modeling,  66 
scattering,  65 
scintillation,  66 
FLIR  systems,  66-72 
target  and  background,  63-65 
Electro-optical  imaging  system  performance 
prediction,  55-120 
atmospheric  effects,  65-66 
detection,  84-91,  97-99 
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FLIR  performance  measures,  77-83,  101- 
106 

FLIR  systems,  66-72 
higher  order  discrimination,  91-99 
search  performance  modeling,  106-115 
static  performance  prediction,  83-106 
symbols,  nomenclature,  and  units,  58-59 
target  acquisition,  60-63 
targets  and  backgrounds,  63-65 
vision  (observer),  72-77 
Electro-optical  imaging  systems  analysis,  1-53 
apparent  quantities,  30-31 
clutter  noise,  32-35 
definitions,  3-7 

extended  source  focal  plane  flux  equation, 
16-18 

extended  source  SNR,  19-22 
imaging  characteristics,  7-9 
impediments  to  source  detection,  9-10 
noise  equivalent  irradiance,  28-29 
noise  equivalent  temperature  difference, 
23-28 

optical  transfer  functions,  37-41 
photon  collection,  11-32 
point  source  irradiance  equations,  18-19 
point  source  SNR,  22-23 
radiant  energy  transfer,  14-15 
sampling  and  aliasing,  44-48 
sensitivity,  23-29 
signal-to-noise  ratio,  11-32,  19 
spatial  frequency  response,  35-44 
spectral  band  selection,  31-32 
symbols,  nomenclature,  and  units,  5-7 
system  design,  49-50 
visual  detection  of  noisy  signals,  48-49 
Electro-optical  imaging  system  design,  49-50 
Electronic  boosting,  39,  71 
Emissivity/emittance,  318-320,  322 
atmospheric,  313,  314 
environmental,  322 

Environmental  radiation  model,  313-318, 
325-326 

Equivalent  line  number,  38 
Ergodic  systems,  218 

Estimation  theory,  247,  251.  See  also  Target 
location  estimation 
Exhaust  plumes,  305,  329-340 
flow  properties,  331 
gas  absorption,  332-333 
geometry,  337-339 
inviscid  core,  334-335,  337-339 
missiles,  321-322,  329 
MWIR  plume  radiation,  332-340 
optical  depth,  334-337 
projected  area,  337-339 
radiance/transmittance,  305,  331-332, 
336-337,  339-340 
radiant  intensity,  336-337,  339 
radiative  transport  equation,  331 
temperature,  321 
Exitance 
photon,  14 
radiant,  14 


Extended  sources,  16-18 
signal-to-noise  ratio,  19-22 
spectral  flux  equation,  17-18 
Eye.  See  Vision 

//#,  4 

Fading,  273 
False  alarms,  257 
Fast  Fourier  transforms,  229,  230 
processor,  274 
Field  of  regard,  3-4,  107 
Field  of  view,  3-4 
Filters 

finite  impulse  response,  276-277 
high-pass,  216-218,  227 
infinite  impulse  response,  276 
Kalman,  252,  285,  289 
matched,  273 
single-pole,  217 
spectral,  32 

Fisher  information  matrix,  270,  275 
Flows,  exhaust,  329-340 
Focal  length,  effective,  4 
Focus,  180 

Forward-looking  infrared  (FLIR)  systems,  66- 
72 

aliasing,  101,  103 
charge  transfer  devices,  103-104 
FLIR90  performance  model,  105-106 
FLIR92  performance  model,  105-106 
higher  order  discrimination,  91-99 
discrimination  performance  example, 
94-96 

image  processing,  104 
image  reconstruction,  104 
modeling,  68-72 

detector  detectivity,  70-71 
display  MTF,  71-72 
electronics,  71 
line-of-sight  jitter,  69 
optics  MTF,  69-70 
NETD  calculation,  26 
nonuniformity,  103 
performance  measures,  77-83 

minimum  detectable  temperature 
difference,  80-81 
minimum  resolvable  temperature 
difference,  81-83 

noise  equivalent  temperature  difference, 
78-80 

resolution,  104-106 
sampling,  101-103 
scanning  systems,  66-67 
staring  systems,  68 
static  performance  prediction,  83-91 
pure  detection,  84-91 
target  acquisition  performance  example, 
86-91 

Fourier  analysis,  37,  68 
Fourier  transforms,  229-230 
Frame  grabbers,  208,  217,  225 
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Gamma  spikes,  273 
Gaussian  statistics,  12,  33-34 
Gimbals,  247,  250,  253,  254,  294 
control  system,  295 
pointing  commands,  290-291 
Glasses.  See  also  Materials 

fracture  mechanics  properties,  132 
Gaussian  strength  properties,  130 
Weibull  strength  properties,  130 
Ground  vehicles,  302,  305 
Gyro  drift,  292 

Heat  transfer,  320,  322-323 
Hessian  matrix,  274 
Histogram  analysis,  285-286 
Histograms,  intensity,  256-257 
Human  visual  system.  See  Vision 

Identity  transfer  function,  272 
Image  blurring,  65-66,  69,  70 
Image  contrast,  68 
Image  distortion,  65-66 
Image  intensifiers,  performance  measures,  77 
Image  quality,  38,  100,  200,  235 
Image  reconstruction,  47,  104 
Image  resolution,  35 
equivalent,  38 
Impulse  response,  36,  40 
Index  of  refraction,  178,  179 
Inertial  navigation  system,  252 
Infrared  imaging  system  testing,  195-243 
contrast  transfer  function,  232-236 
minimum  resolvable  temperature,  235-241 
modulation  transfer  function,  223-232 
overview,  197-202 

radiometry  and  temperature  difference, 
203-206 

signal  transfer  function,  209-212 
slit  response  function,  221-223 
symbols  and  nomenclature,  197 
test  configurations,  206-209 
three-dimensional  noise  model,  212-221 
Instantaneous  field  of  view,  70,  101 
Interpolator,  47-48 
Invar,  182 
Irradiance 

energy,  14-15 
photon,  14-15 
Isoplanatic  patch,  36 

Jitter,  69,  228-229,  252,  292 

Kirchhoffs  law,  318,  320 

Lens  barrels,  150-156 
barrel  sealing,  155-156 
pressurizing,  156 


semiflexible  adhesive  bonding,  154-156 
design,  151-155 

common  bore  assembly,  151,  154 
individual  seat  assembly,  151,  154 
subcell  assembly,  154-155 
materials,  150-153 
metallic,  152 
nonmetallic,  153 
Lens  materials 

stress-optical  coefficient  (stress 
birefringence),  148 
Lenses,  mounting,  140-150,  185-187 
bonded  lens  mounts,  143-145,  185-187 
adhesives,  properties  of,  143 
design  example,  185-187 
semiflexible  bonding,  144 
center  of  gravity/weight  estimates,  141-143 
lens  centering,  140-141 
mechanical  stress,  148-149 
bending  stress,  148 
contact  stress,  149 
Hertz  contact  stress  theory,  149 
optical  path  difference,  148 
stress-optical  coefficient  (stress 
birefringence),  148 
seat  and  retainer  mounts,  146-148 
accuracy,  146 
design  example,  187 
retainer  design,  147-148 
sharp  corner  contact,  147 
spherical  contact,  147 
tangential  contact,  147 
shimmed  mounts,  145-146 
thermal  stress,  149-150 

minimum  radial  clearance,  149 
radial  stress,  150 
Likelihood  ratio  test,  287 
Line  spread  function,  223,  225-230 
Line-of-sight 
control,  267 

determination,  247,  251-252,  253,  289-290, 
292,  294,  295 
stabilization,  253-254 
Loadline  procedure,  96-97 
Localize,  62 
Lookup  tables,  256 

Loss  of  lock,  292-293,  295.  See  also  Breaklock 
loss-of-lock  probability,  293 
LOWTRAN,  7,  66,  341 

AT,  21,  31-32 
Mach  number,  321,  322 

and  exhaust  plumes,  334-335 
Materials 

bimetallic  compensators,  181-182 

lens  barrels,  150-153 

metal  mirrors,  165-167 

thermal  coefficient  of  expansion,  170-171 

thermal  diffusivity,  169 

thermal  distortion  parameter,  169 

thermo-optic  coefficients,  179-181 
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Maximum  likelihood  target  location 
estimators,  263-271,  280 
correlation  trackers,  271-276,  278-280 
least-squares  cost  function,  272,  273, 
274 

on-line  correlation  algorithm,  274-275 
performance,  275-276 
quadratic  loss  function,  273 
likelihood  function,  263 
maximum  likelihood  tracking,  267-271, 
280 

conditional  log-likelihood  functions,  268 
conditional  probability  function,  267 
log-likelihood  function,  267-270 
performance,  271 

predictor/corrector  algorithm,  268,  270 
multimode  tracking,  277-280 
overlay  model,  263-267,  272 
architecture,  264 
Metal  matrix  composites,  167 
athermalizing  structures,  182 
Minimum  detectable  contrast,  77 
Minimum  detectable  temperature  difference 
(MDT),  80-81 

Minimum  resolvable  contrast,  77 
Minimum  resolvable  temperature  difference 
(MRT),  49,  81-83,  85,  101-102,  105,  106, 
201,  216,  235-241 
as  a  function  of  noise,  237 
geometric  average  of,  238 
phasing  effects  on,  238 
sampling  effects  on,  238 
specifications,  241 
for  a  staring  array,  239 
test  configuration,  240 
test  procedure,  240 
Mirrors,  mounting,  172-177,  187-188 
bonded  mounts,  176-177 
mushroom  mount,  176-177 
design  example,  187-188 
flexural  mounts,  175-176 
kinematic  mounts,  172-174 
semikinematic  mounts,  174—175 
Mirrors,  optomechanical  design,  156-172 
contoured  back  lightweight  mirrors,  160- 
161 

double-arch,  161 
double  concave,  161 
single-arch,  160 
flexural  rigidity 

for  open-back  mirror,  162-163 
for  sandwich  mirror,  162-164 
lightweight  mirrors,  159-164,  188-190 
design  example,  188-190 
weight  estimation,  159,  162,  163 
materials,  167 

thermal  coefficient  of  expansion,  170 
metal  mirrors,  165-168 
advantages,  165 
aluminum,  167,  170 
Andrade’s  beta  law,  166 
athermalization,  178' 
beryllium,  167, 170 


bimetallic  bending  effects  in,  171-172 
dimensional  stability,  165 
disadvantages,  165 
materials  for,  165,  167 
metal  matrix  composites,  167 
metallurgical  stability,  165 
microyield,  166 

microyield  strength  (precision  elastic 
limit),  166 

residual  stress  release,  166 
stabilizing  heat  treatments,  167 
rib-reinforced  lightweight  mirrors,  162-164 
open-back  mirror,  162-163 
sandwich  mirror,  162 
self-weight  deflection,  156-159 
axial  self-weight  deflection,  157 
number  of  support  points,  158 
quilting,  163-164 

radial  self-weight  deflection,  158-159 
surface  deflection  equation,  156 
solid-glass  mirrors,  weight  estimation,  159 
thermal  effects  on,  168-172,  191-192 
bimetallic  bending  effects,  171-172 
interior  temperature,  169 
temperature-induced  distortion,  168- 
169 

thermal  coefficient  of  expansion,  170- 
171 

thermal  diffusivity,  169 
thermal  distortion  parameter,  169 
MODTRAN,  313 
Modulation,  200 
Modulation  transfer  function 

contrast  transfer  function,  232-236 
detector,  70 
detector  optics,  69-70 
direct  method  determination,  200 
effects  on  measurement 

background  removal,  226-227 
jitter,  228-229 
noise,  229,  230 
normalization,  230-231 
sampling,  225 

example  calculations  from  square -wave 
response,  235 
FLIR  systems,  68,  100 
Fourier  transform  considerations,  229 
human  visual  system,  77 
indirect  method  determination,  200 
line  spread  function,  223,  225-230 
methodology,  223 

minimum  resolvable  temperature,  235 
MTF  variations,  232 
sensor,  272 
system,  37-42 

system,  measurement  of,  199-201,  223-235 
test  configuration,  224 
Mounting,  See  Lenses,  mounting;  Mirrors, 
mounting;  Prisms,  mounting;  Windows  and 
domes 

Multimode  tracking,  277-280 
Multiplexers,  104 
Multiplexing,  67 
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N50)  92,  97,  98,  99,  100 
Noise,  7,  10,  12-14,  199,  252,  257,  276-277 
1  If,  13,  216,  219,  226 
additive,  272 
background,  82 
clutter,  32-35 
detector,  80 
directional,  106 
display,  83 

effects  on  system  MTF  measurement,  229 
filtering,  83 

fixed  pattern,  13-14,  103,  216,  218-220, 

222 

generation,  12-13 
generation-recombination,  13 
high-frequency,  216-218 
Johnson,  13 
low-frequency,  216-218 
and  minimum  resolvable  temperature,  235, 
237 

photon,  12,  22 
pickup,  13 
pixel,  258,  266 
power  spectral  density  of,  13 
reduction,  286 
sensor,  258,  262,  269,  272 
spatially  independent  and  identically 
distributed,  258,  260,  272 
temperature,  13 
temporal,  216,  218 
thermal,  13 

three-dimensional  noise  model,  212-221 
tunneling,  13 
white,  259 

Noise  equivalent  flux  density,  28 
Noise  equivalent  irradiance,  11,  28-29 
Noise  equivalent  power,  11,  20 
Noise  equivalent  temperature  difference 
(NET),  11,  23-28,  78-80,  198-199,  216-220, 
222 

Noise  foldover,  46 

Nonuniformity,  216-217,  219-220,  222 
Nozzles.  See  Exhaust  plumes,  330 
Nyquist  criterion,  46,  208,  229 
Nyquist  frequency,  101,  200,  238 

Obscuration  factor,  304 
Observers 

determining  minimum  resolvable 
temperature,  235-241 
Optical  aperture  area,  3-4 
Optical  depth,  334-337 
Optical  energy  collection,  17 
Optical  path  difference,  124,  148 
Optical  transfer  function,  37-41,  68 
Optical  transmission,  apparent,  30 
Optomechanical  system  design,  121-194.  See 
also  Athermalization;  Lens  barrels;  Lens 
mounting;  Mirror  design/mounting;  Prisms, 
mounting;  Windows  and  domes 


athermalization,  177-183 

example  problems,  183-192 

lens  barrels,  150-156 

lens  mounting,  140-150 

mirror  design/mounting,  156-177 

prisms,  136-140 

windows  and  domes,  123-135 

Paint,  303 

Parallel  processing,  274 
Phase  transfer  function,  37,  41,  68 
Photoconductive  detectors 
noise,  13 

Photodiode  detectors 
noise,  13 

Photon  collection  time,  290-291 
Photon  flux,  14 
Photons,  number  of,  14 
Pipeline  processor,  273 
Pixel  intensity,  258,  260 
Pixel  intensity  map,  266 
Pixels 

background,  260,  272,  285 
resolvable,  99-100,  105 
target,  260,  272,  285 
Planck  blackbody  radiance  function,  302 
Plumes.  See  Exhaust  gases 
Point  sources,  18-19,  29 

irradiance  equations,  18-19 
Point  spread  function,  68,  70,  261,  266 
Pointing  accuracy,  293-294 

small-signal  analysis,  293,  295 
steady-state  error,  294 
tracking  system  pointing  error,  294 
Pointing  error  variance,  258-260 
Poisson  statistics,  12,  33 
Postfiltering,  46,  48 
Power  spectral  density,  13,  34 
Prefiltering,  46 

Principle  of  uncertainty  equivalence,  251 
Prisms,  mounting,  136-140,  185 
flexure  mounting,  137-139 
kinematic  mounting,  137-138 
large  contact  area  mounts,  138-140 
prism  bonding,  136-137 
prism  mounting  example,  185 
springs,  138 

Probability  density  function,  258 
Probability  of  detection,  65,  100,  84—85,  110- 
115 

Processors,  digital,  254 

Quantum  efficiency,  22 

Radiance,  14-15,  303-304 
atmospheric,  325 
energy,  14-15 
object,  305 
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photon,  14-15 

Radiant  energy  transfer,  14-15 
Radiant  flux,  14 

Radiant  intensity,  304,  327-328,  336-341 
Radiation  environment  model,  313-318,  325- 
326 

Radiation  temperature,  63 
Radiative  transport  equation,  331 
Radiometry,  and  temperature  difference,  203- 
206 

radiant  exitance  difference,  203-205 
Radius  of  gyration,  259 
Recovery  factor,  321 
Recovery  temperature,  321 
Reference  adaptation,  276-277,  279-280,  294 
Reference  image,  273 

Reflections/reflectance,  305,  318-320,  323- 
328.  See  also  Earthshine;  Skyshine;  Solar 
reflections 
BRDF,  318-320 
opaque  surface,  323-328 
specular,  319 

surface  roughness  effects,  319 
Resolution,  imaging  system,  99-100,  101,  104r- 
106,  198,  200 
imaging,  198-199 

instantaneous  field  of  view  (geometric),  198 
resolvable  pixels,  99-100,  105 
slit  response  function,  221-223 
Responsivity 
apparent,  30 
spectral,  19 

Responsivity  function,  198,  203,  209-211 
test  configuration,  210 
RST  transform,  267,  272 

Sampling,  44-48,  101-103 
postfiltering,  103 
prefiltering,  103 
sample-scene  phase  effect,  101 
staring  array  example,  47 
Saturated  signal,  7 
Scanning  IR  imaging  systems 
noise  model,  213-214 
Scattering,  atmospheric,  313,  314 
Scintillation,  66,  273 
Search,  57,  62,  106-115.  See  also  Target 
acquisition 

competition  search,  108 
display  search,  62,  107,  110-113 

search  detection  probability,  111-113 
modeling,  109-115 

NVESD  search  model,  110-115 
visual  search,  109-110 
visual  (field  of  regard)  search,  107-108, 
113-115 

probability  of  detection,  115 
Segmentation,  254,  256,  258 
Sensitivity,  detector,  11,  80-82.  See  also  Noise 


equivalent  temperature  difference 
Separation  principle,  251 
Shape  factor,  18-19 
Ships,  302,  305 
Signal  dropouts,  257 

Signal  processing  optical  transfer  functions, 
40-41 

Signal  transfer  function,  198,  209-213 
data  set,  212 
example,  212-213 
specification,  211 
test  procedure,  211 
Signal-to-noise  ratio,  7,  11,  12,  28-29 
extended  sources,  19-22 
perceived,  48-49 
point  sources,  22-23 
target  imagery,  261-262,  287 
and  target  position  estimation,  43 
Signatures.  See  also  Target  signature 
prediction  and  modeling;  Target  signatures 
apparent,  64 
background,  63 
inherent,  64-65 
source,  9 
target,  63-65 

Simulation,  tracking  system,  295-296 
Skyshine,  305,  316-318,  325-328,  341 
Slit  response  function,  199,  221-223 
specifications,  222 
test  configuration,  222 
test  procedure,  223 
Small-signal  analysis,  293,  295 
Snell’s  law,  319 
Solar  heating,  322-323 
Solar  radiation,  302,  314-315 
Solar  reflections,  305,  313,  324-326,  341 
Spatial  frequency,  202 
Spatial  frequency  response  of  EO  imaging 
systems,  35-44 
linear  filter  theory,  36 
optical  transfer  function,  detector,  40 
optical  transfer  function,  optical,  39-40 
optical  transfer  function,  signal  processing, 
40-41 

optical  transfer  function,  system,  37-41 
central  limit  theorem,  38-38 
central  ordinate  theorem,  39 
electronic  boost,  39 
equivalent  bandwidth,  38 
equivalent  Gaussian,  38-39 
square-wave  response,  41-42 
target  position  estimation,  theoretical 
limit,  42-44 

angular  measurement  precision,  43 
resolution  scale,  42-43 
Spatial  resolving  power,  7 
Spectral  band  selection,  31-32 
Square-wave  response,  41-42 
Stanton  number,  322 
Staring  IR  imaging  systems 
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calculating  degrees  of  freedom,  10-1 1 
noise  model,  213-214 
Static  performance,  57 
Sun,  313-315 

Superposition  integral,  35-36 
Surface  radiance 
LWIR,  327-328 
MWIR,  327-328 

Symbols,  nomenclature,  and  units,  5-7,  58-59, 
197,  248-250 

Target  (object)  body  temperature,  320-323 
Target  acquisition,  57,  60-63.  See  also 
Detection;  Discrimination;  Search 
definitions,  62-63 
detection,  83-91 
FLIR  example,  86-91,  94-96 
higher  order  discrimination,  91-99 
Johnson  methodology,  91-92 
performance  factors,  61 
target  aspect,  97-98 
Target  aspect,  97-98,  99 
Target  contrast,  256,  262,  270,  293 
Target  gating,  252,  253,  259,  280-287 
gate  and  search  geometry,  284 
gate  construction,  281-285 
geometry,  283 
sizing,  281-285 
gating  function,  261 
target  length  estimation,  285-286 
edge  algorithm,  285-286 
histogram  analysis,  285-286 
target  segmentation,  286-287 
Target  geometry,  306-313 

basic  coordinate  system,  306,  310 
rectilinear  coordinate  system,  308-309 
target  coordinate  system,  307-309 
target  shape,  307-308 
target  surface  area,  309-312 
Target  indicator  function,  266 
Target  location  estimation,  251,  254-280,  290- 
291 

binary  centroid  trackers,  254-260,  280 
correlation  trackers,  271-276,  280 
errors,  258,  260 

intensity  centroid  trackers,  260-263,  280 
maximum  likelihood  estimators,  263-271, 
280 

multimode  tracking,  277-280 
target  location  algorithm  comparison,  279- 
280 

tracker  adaptation  and  drift,  276-277 
Target  nuisance  parameters,  270,  271,  272 
Target  parameters,  266-267,  272 
Target  radiance,  apparent  change  in,  30 
Target  recognition,  automatic,  286-287 
Target  reference,  272 
Target  segmentation,  286-287 
Target  signature  prediction  and  modeling, 
301-342 


bidirectional  reflectance  distribution 
function/emissivity  model,  318-320 
exhaust  plumes,  329-340 
flow  properties,  331 
MWIR  plume  radiation,  332-340 
radiance/transmittance,  331332 
intensity  relations,  303-305 
radiation  environment  model,  313-318 
signature  phenomenology,  302 
surface  reflections  and  emissions,  323-328 
earthshine,  325 
skyshine,  325-328 
solar  reflection,  324 
target  geometry,  306-313 
target  (object)  body  temperature,  320-323 
Target  signatures,  261,  263,  265-267,  272, 
276,  293 

Target  transform  probability  function,  92-93 
Targets 

bimodal,  256 
critical  dimension,  64 
maneuvering,  266 
military,  301 
modeling,  64-65 
signal-to-noise  ratio,  85 
Television  sensors,  performance  measures,  77 
Temperature 

boundary  layer,  321 
clouds,  314 
environmental,  322 
foliage,  314 
gas,  334 

of  ground  vehicles,  323 
recovery,  321,  322 
of  ships,  323 
soil,  314 
stagnation,  321 
target  (object),  320-323 
total,  321 
water,  314 

Temperature  difference,  63-65,  85,  203-206. 
See  also  Minimum  detectable  temperature 
difference;  Minimum  resolvable  temperature 
difference;  Noise  equivalent  temperature 
difference 
apparent,  9,  31 

background  temperature,  204-205 
and  minimum  resolvable  temperature,  205 
and  noise  equivalent  temperature 
difference,  205-206 
Test  configurations,  206-209 

atmospheric  transmittance,  208 
collimators,  206-208 
video  output,  208-209 
Thermal  coefficient  of  expansion 

and  athermal  compensators,  179-180 
of  mirror  materials,  170-171 
Thermal  distortion  parameter,  123,  169 
Thermal  emission,  302,  305,  313,  322 
Thermal  imaging  systems 
analysis  of,  1-53 
performance  prediction,  55-120 
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Thermal  infrared,  and  clutter,  34 
Thermo-optic  coefficient,  179 
Three-dimensional  noise  model,  212-221 
coordinate  system,  212-213 
data  sets,  215 

fixed-pattern  noise,  216,  218-220 
Gaussian  statistics,  219-221 
noise  components,  214 
noise  descriptors,  215 
noise  equivalent  temperature  difference 
(NETD),  216-220 

noise  measurement  test  configuration,  216 
nonuniformity,  216-217,  219-220 
Threshold  exceedances,  255,  257 
Track  loop,  247 

architecture,  251-254 

separation  principle,  251 
coast  mode,  289 

compensation,  253-254,  290-292,  294 
architecture,  291 
bandwidth,  291 

loop  latency  (transport  delay),  290-291 
steady-state  tracking  error,  291 
controller,  252 
mode  diagram,  290 
performance  prediction,  292-296 
Tracker  drift,  277 

Tracker  signature  adaptation,  276-277 
Tracking  accuracy,  292 
vs  gate  size,  281-282 
instantaneous  track  error,  292 
Tracking  and  control  systems,  245-298 

automatic  video  tracking  systems,  247-251 
breaklock  detection,  287-288 
line-of-sight  determination,  289-290 
symbols,  nomenclature,  and  units,  248-250 
target  gating,  280-287 

gate  construction,  281-285 
histogram  analysis  target  length 
estimation,  285-286 
target  segmentation,  286-287 
target  location  estimation,  254-280 

binary  centroid  trackers,  254-260,  278- 
280 

correlation  trackers,  271-276,  278-280 
intensity  centroid  trackers,  260-263, 
280 

maximum  likelihood  estimators,  263- 
271,  280 

multimode  tracking,  277-280 
target  location  algorithm  comparison, 
279-280 

tracker  adaptation  and  drift,  276-277 
track  loop  architecture,  251-254 
track  loop  compensation,  290-292 
track  loop  performance  prediction,  292-296 
Tracking  error,  276,  291 
Tracking  jitter,  282 
Transmissivity,  gas,  334 
Transmittance 

atmospheric,  314,  318,  324-325,  341 
average,  336 


average  pathlength,  336 
Trend  removal,  216 
Troposphere,  302 
Turbulence,  atmospheric,  65 

Video  gate,  278 
Video  map,  254-262,  278 
Video  monitors,  208,  239 
Video,  output,  208-209,  216-217,  230 
RS  170  video  format,  216,  225 
Video  tracking  systems,  automatic,  247-251 
Vision,  48-49,  72-78 
acuity,  73,  76 
eye  movements,  107 
glimpse,  107 
saccades,  107-108 
modeling  vision,  76-77 

modulation  transfer  function,  77-78 
signal-to-noise  ratio,  76 
sensitivity,  72-73 
spatial  summation,  73-74,  76 
temporal  summation,  75-76 
visual  search,  107-108 
Visual  sensitivity,  200,  235,  237-239 

and  noise  power  spectral  density,  236,  237 

Water  vapor,  332-333 
Weighting  function,  284 
Whittaker-Shannon  sampling  theorem,  46 
Windows  and  domes,  123-135,  184-185 
dome  design  example,  184^185 
dome  geometry,  127 
dome  mounting,  128 

dome  stress  due  to  pressure  differentials, 
126-128 

aerodynamic  loading  stresses,  127-128 
elastic  buckling,  127 
Lame  pressure  vessel  equations,  126 
fundamental  frequency,  133 
for  a  circular  window,  133 
for  a  rectangular  window,  133 
mounting,  134-135,  137 
adhesive  bonds,  134,  137 
bezel,  134 

mechanical  contact,  134-135 
mount-induced  deformations,  effects  of, 
134 

O-ring  seals,  135 
tolerance,  124 

pressure-induced  window  deformation, 
124-125 

thermal  effects  on,  123-124 

axial  temperature  gradients,  123-124 
radial  temperature  gradients,  124 
window  design  example,  183-184 
window  strength,  128-133 
amplitude  factor,  132-133 
fracture  mechanics  properties  of 
glasses,  132 

Gaussian  probability  distribution,  129 
Gaussian  strength  properties  of  glasses, 
130 
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probability  of  failure,  129 

service  lifetime,  sinusoidal  loading,  132 

service  lifetime,  static  loading,  131-132 

static  fatigue,  131-132 

stress-failure  relations,  129-130 

surface  fracture,  129 

time  to  failure  after  proof  testing,  131 


Weibull  probability  distribution,  129 
Weibull  strength  properties  of  glasses, 
130 

window  stress  due  to  pressure  differentials, 
125-126 

aspect  ratio,  125 

Windows,  Hanning  (raised  cosine),  230 


